Management of media content derived from natural language processing on mobile computing devices

ABSTRACT

A system may facilitate communication between a messaging platform associating a hash tag with a message and a content matching platform. A natural language processing (NLP) facility may produce at least one of an understanding, theme, emotion, and intent of a message. A metadata matching facility may identify candidate hash tags by determining similarity from a pool of hash tags with an output of the NLP, where the content matching facility communicates at least one of the candidate hash tags to the messaging platform. In another aspect, a method may include communicating a message to a content matching platform, and processing text of the message with NLP to generate NLP output including at least one of a theme, understanding, intent, and emotion of the message. A candidate hash tag may then be determined and communicated based on similarity of the NLP output with a plurality of hash tags.

RELATED APPLICATIONS

This application is a bypass continuation that claims priority toInternational Pat. App. No. PCT/US18/64962 filed on Dec. 11, 2018(published as WO/2019/118469 on Jun. 20, 2019), which claims priority toU.S. Prov. App. No. 62/597,309 filed on Dec. 11, 2017, where the entirecontent of each of the foregoing is incorporated herein by reference inits entirety as if fully set forth herein.

This application is also a continuation-in-part of U.S. patentapplication Ser. No. 16/158,000 filed on Oct. 11, 2018, which is acontinuation of U.S. patent application Ser. No. 15/725,645 filed onOct. 5, 2017 (“the '645 application”) (now U.S. Pat. No. 10,104,228),which is a continuation-in-part of U.S. patent application Ser. No.15/469,772 filed on Mar. 27, 2017 (now U.S. Pat. No. 9,871,902), whichis a continuation of U.S. patent application Ser. No. 15/142,200 filedon Apr. 29, 2016 (now U.S. Pat. No. 9,609,124), which claims the benefitof U.S. Prov. Pat. App. No. 62/155,706 filed on May 1, 2015. The '645application further claims priority to U.S. Prov. Pat. App. No.62/459,742 filed on Feb. 16, 2017, and U.S. Prov. Pat. App. No.62/486,495 filed on Apr. 18, 2017. The '645 application is a bypasscontinuation-in-part of International Pat. App. No. PCT/US2016/30083filed on Apr. 29, 2016 (published as WO/2016/178984 on Nov. 10, 2016).The entire content of each of the above-identified applications ishereby incorporated by reference in its entirety as if fully set forthherein.

TECHNICAL FIELD

This application relates to the field of mobile devices, and moreparticularly to the management of content, such as ring tones and video,that may be played when one user contacts another via a mobile device.

BACKGROUND

The proliferation of mobile devices has enabled a wide range of highlypersonalized social interactions, such as sharing of photos, videos, andmusic, among other types of content. However, the contact function of atypical mobile device is quite generic, typically providing analphabetized list of names, with phone numbers and other basic contactinformation. Calls and texts between users typically identify the user,and may even play a selected ring tone that is selected by the recipientof the call or text to play when a particular individual calls or texts,but the event of a call or text is otherwise un-customized.

Users might create content that could be played upon contact events, butin current systems another user would need to undertake significantinteractions in order for them to be played, and the content would tendto go stale without significant effort on the part of a receiver of acall or text.

A need exists for improved methods and systems for managing the contactsmodules and functions of mobile devices.

SUMMARY

In embodiments, methods and systems of content matching may include asystem that includes a computer to computer interface configured tofacilitate communication between a messaging platform that is adapted toassociate a hash tag with a message and a content matching platform, thecommunication between the messaging platform and the content matchingplatform comprising at least one of messages and hash tags. The systemmay include a natural language processing facility of the contentmatching platform producing an output comprising at least one of anunderstanding, theme, emotion, and intent of a message communicated fromthe messaging platform. The system may also include a metadata matchingfacility in communication with the content matching platform, themetadata matching facility configured to identify candidate hash tags bydetermining similarity of hash tags in a pool of hash tags with anoutput of the natural language processing, the content matching facilitycommunicating at least one of the candidate hash tags to the messagingplatform over the computer to computer interface. The system may furtherinclude an electronic user interface that facilitates user selection ofone or more of the candidate hash tags that the content matchingfacility communicates to the messaging platform for associating with themessage processed by the natural language processing facility. In thesystem, the computer to computer interface may include an ApplicationProgramming Interface (API). In the system, determining similarity ofhash tags with an output of the natural language processing of themessage may include determining similarity of metadata associated withthe hash tags. In the system, the metadata associated with the hash tagsmay be generated by processing the hash tags with the natural languageprocessing facility. In the system, the at least one of the candidatehash tags may indicate an emotion of the message. In the system, the atleast one of the candidate hash tags may indicate an intent of themessage. In the system, the content matching platform may tag themessage with the at least one candidate hash tags and communicates thetagged message to the messaging platform. The system may further includethe content matching platform communicating the output of naturallanguage processing of the message to the messaging platform.

In embodiments, methods and systems of content matching may include asystem that includes a computer to computer interface configured tofacilitate communication between a messaging platform that is adapted toassociate a hash tag with a message and a content matching platform, thecommunication between the messaging platform and the content matchingplatform comprising at least one of messages and hash tags. The systemmay further include a natural language processing facility of thecontent matching platform producing an output comprising at least one ofan understanding, theme, emotion, and intent of a message communicatedfrom the messaging platform and of a plurality of hash tags in a pool ofhash tags. The system may further include a metadata matching facilityconfigured to determine candidate hash tags by determining similarity ofan output of the natural language processing for the plurality of hashtags with an output of the natural language processing for the messagecommunicated from the messaging platform, the content matching facilitycommunicating at least one candidate hash tag based on the determinedsimilarity to the messaging platform over the computer to computerinterface. In the system, the output of the natural language processingof the at least one candidate hash tag may be more similar to the outputof the natural language processing of the message than the naturallanguage processing of any of the other hash tags in the pool of hashtags. The system may further include an electronic user interface thatfacilitates user selection of one or more of the candidate hash tagsthat the content matching facility communicates to the messagingplatform for associating with the message processed by the naturallanguage processing facility. In the system, the computer to computerinterface may be an Application Programming Interface (API). In thesystem, determining similarity of hash tags with an output of thenatural language processing of the message may include determiningsimilarity of metadata associated with the hash tags. In the system, themetadata associated with the hash tags may be generated by processingthe hash tags with the natural language processing facility.

In embodiments, methods and systems of content matching may includecommunicating a portion of a message from a messaging platform to acontent matching platform. The method may also include processing textin the portion of the message with natural language processing, therebygenerating an NLP output comprising at least one of a theme,understanding, intent, and emotion of the message. The message may alsoinclude determining similarity of the NLP output with a plurality ofhash tags. The method may also include communicating at least onecandidate hash tag for the message to the messaging platform based onthe determined similarity. In the method, determining similarity mayinclude comparing a portion of the NLP output with the hash tags. In themethod, determining similarity may include comparing a portion of theNLP output with metadata descriptive of the hash tags. The method mayfurther include facilitating user selection of the at least onecandidate hash tag by presenting in an electronic user interface aplurality of hash tags based on the determined similarity. In themethod, the communicating a portion of a message and communicating atleast one candidate hash tag may utilize an Application ProgrammingInterface between the content matching platform and the messagingplatform.

Provided herein are methods and systems for a sender-controlled contactmedia content type (referred to herein in some cases as “SCCMC”) thatcan be sent among mobile devices, including addressing the contactssystems and methods of such devices to provide rich interactions amongusers upon the occurrence of contact events. Such methods and systemsmay occur at the level of the contacts functions of a mobile device,such as being initiated directly upon a contact independent of the needfor an application on the recipient's mobile device. In embodiments, theSCCMC can play, for example, on the lock screen of the recipient'smobile device as an incoming call occurs, or the SCCMC can display on acontact screen when the phone is unlocked and active, including, withoutlimitation, on the home screen of the recipient's mobile device, on ascreen that displays when the recipient is on a phone call and/or whenthe recipient is using an application on the recipient's mobile device.The methods and systems described herein may allow a first user (user A)to create custom photos, videos, ring tones and the like that areplayed, under control of user A, on the mobile device of another user(user B), such as when user A calls or texts user B's device. Forexample, user A may create a video, with associated audio content, anddeliver that content to user B's phone, and have the video and audioplay on user B's phone when user A contacts user B, such as by text orcall. The content may, in a single broadcast act, comprise both voicelayer and data layer content and use, in a coordinated fashion, voicelayer and data layer transmission mediums. Such content is referred toherein as a sender-controlled contact media content item (“SCCMC”) or,in some cases as a “Ving” or a “Vyng.”

Provided herein are methods and systems for providing asender-controlled contact media content data structure that is adaptedto be created using a mobile device of a sender and sent to at least onemobile device of at least one recipient; and a host computing systemincluding at least one server for managing the sender-controlled contactmedia content data structure; wherein the sender-controlled contactmedia data structure is adapted to be displayed via the contactsfunction of the mobile device of a recipient under control of the senderof the sender-controlled contact media content data structure.

Methods and systems are provided herein, including methods and systemsthat include a sender-controlled contact media content data structurethat is adapted to be created using a mobile device of a sender and sentto at least one mobile device of at least one recipient; and a hostcomputing system including at least one server for managing thesender-controlled contact media content data structure; wherein thesender-controlled contact media data structure is adapted to bedisplayed on a screen of a recipient's mobile device when therecipient's device is turned on and able to receive at least one of adata signal and a voice signal, wherein the sender-controlled contactmedia data structure displays content that is under the control of thesender of the sender-controlled contact media content data structure.

In embodiments, the sender-controlled contact media content datastructure uses voice layer and data layer transmission mediums in asingle broadcast act by the sender. In embodiments, the screen of therecipient's mobile device is the screen that displays upon theoccurrence of a contact event at the recipient's mobile device. Inembodiments, the screen of the recipient's mobile device is the lockscreen of the recipient's mobile device. In embodiments, the screen ofthe recipient's mobile device is the home screen of the recipient'smobile device. In embodiments, the screen of the recipient's mobiledevice is an active screen of the recipient's mobile device thatdisplays when the mobile device is unlocked. In embodiments, the screenof the recipient's mobile device is a screen that displays while therecipient is on a phone call using the recipient's mobile device.

The methods and systems disclosed herein may include an installableapplication running on the host computing system for establishing a dataconnection between the mobile device of the sender and the at least onemobile device of the at least one recipient. In embodiments, theinstallable application is configured to allow discovery of peer devicesin proximity to allow an exchange of the sender-controlled contact mediacontent data structure between the mobile device of the sender and theat least one mobile device of the at least one recipient. Inembodiments, the installable application enables a user interface thatallows the creation of the sender-controlled contact media content datastructure on the mobile device of the sender.

In embodiments, the host computing system enables downloading of thesender-controlled contact media content data structure on the at leastone mobile device of the at least one recipient.

In embodiments, the mobile device of the sender and the at least onemobile device of the at least one recipient are communicatively coupledto the server, and wherein the server is a content server. Inembodiments, the mobile device of the sender is communicatively coupledto mobile devices of a plurality of recipients, such that each of therecipient devices receives the sender-controlled contact media contentdata structure. In some cases, this is described as a “bomb,” a “Vyngbomb,” or the like.

In embodiments, a plurality of sender-controlled contact media datastructures is organized into a channel, such that at least onerecipient's mobile device plays a series of the sender-controlledcontact media data structures upon a plurality of contact events from atleast one sender. In embodiments, the channel is associated with atleast one of a topic of interest to a sender, a topic of interest to atleast one recipient and a social graph of at least one of a sender andat least one recipient. In embodiments, the sender-controlled contactmedia data structures are selected by the sender from a curated libraryof sender-controlled contact media data structures. In embodiments, thelibrary is curated by an algorithm based on a topic of interestindicated by at least one of the sender and the recipient. Inembodiments, the library is curated by an editor based on the subjectmatter of the channel.

The methods and systems described herein may include methods and systemsfor taking a sender-controlled contact media content data structure thatis created using a mobile device of a sender; providing a host systemthat enables transmission of the sender-controlled contact media contentdata structure from the mobile device of the sender to at least onemobile device of at least one recipient; and causing the display of thesender-controlled contact media content data structure on a screen ofthe at least one mobile device of the at least one recipient when the atleast one recipient's device is turned on and able to receive at leastone of a data signal and a voice signal, wherein the sender-controlledcontact media data structure displays content that is under the controlof the sender of the sender-controlled contact media content datastructure. In embodiments, the sender-controlled contact media contentdata structure uses voice layer and data layer transmission mediums in asingle broadcast act by the sender. In embodiments, the screen of therecipient's mobile device is the screen that displays upon theoccurrence of a contact event at the recipient's mobile device. Inembodiments, the screen of the recipient's mobile device is the lockscreen of the recipient's mobile device. In embodiments, the screen ofthe recipient's mobile device is the home screen of the recipient'smobile device. In embodiments, the screen of the recipient's mobiledevice is an active screen of the recipient's mobile device thatdisplays when the mobile device is unlocked. In embodiments, the screenof the recipient's mobile device is a screen that displays while therecipient is on a phone call using the recipient's mobile device. Inembodiments, the sender-controlled contact media content data structurecomprises one or more of audio, video, contact data, and metadata. Inembodiments, sending the sender-controlled contact media content datastructure comprises sending a text message, wherein the text messageincludes an embedded link to facilitate installation of an applicationby the at least one recipient on the at least one mobile device of theat least one recipient upon tapping of the embedded link by the at leastone recipient, wherein the installable application establishes a dataconnection between the mobile phone of the sender and the mobile phoneof the at least one recipient.

In embodiments, the methods and systems described herein may furtherinclude downloading of the sender-controlled contact media content datastructure on the at least one mobile device of the at least onerecipient using the embedded link, wherein the downloading of thesender-controlled contact media content data structure enablesdisplaying a contact of the sender as being associated with thesender-controlled contact media content data structure on the at leastone mobile device of the at least one recipient.

In embodiments, the methods and systems described herein may furtherinclude initiating a contact by the mobile device of the sender with theat least one mobile device of the at least one recipient such that thesender-controlled contact media content data structure is displayed onthe at least one mobile device of the at least one recipient when thecontact between the mobile device of the sender and the at least onemobile device of the at least one recipient initiates. In embodiments,the contact is initiated between the mobile device of the sender and theat least one mobile device of the at least one recipient when the senderplaces a phone call. In embodiments, the contact is initiated betweenthe mobile device of the sender and the at least one mobile device ofthe at least one recipient when the sender sends a text message to theat least one mobile device of the at least one recipient.

In embodiments, the methods and systems described herein may furtherinclude enabling a user interface on the mobile device of the sender toallow the creation of the sender-controlled contact media content datastructure through the user interface. In embodiments, the user interfacefurther allows editing of the sender-controlled contact media contentdata structure from an external source that stores the sender-controlledcontact media content data structure. In embodiments, the externalsource comprises one of a cloud repository and a library of athird-party content provider. In embodiments, the user interface allowsfor the creating the sender-controlled contact media content datastructure associated with an emotional state of the sender. Inembodiments, the emotional state is indicated through a data field inmetadata associated with the sender-controlled contact media contentdata structure. In embodiments, the emotional state is indicated by oneor more of a facial expression, an image, a sound, and an emoticon.

In embodiments, the methods and systems described herein may furtherinclude setting a privacy control through the installable application tolimit publication of the sender-controlled contact media content datastructure to a select audience.

The methods and systems disclosed herein may include methods and systemsfor segregating the created sender-controlled contact media content datastructure into one or more of audio, video, and metadata components;associating each of the components of the created sender-controlledcontact media content data structure with a particular tone; and storingthe tone for each of the components locally on the mobile device of thesender. In embodiments, the methods and systems described herein mayfurther include uploading the tone for each of the components on anapplication server or a content server. In embodiments, the methods andsystems described herein may further include allowing previewing thesender-controlled contact media content data structure; and addingcustom details to the sender-controlled contact media content datastructure, either before or after sending the sender-controlled contactmedia content data structure to the at least one recipient. Inembodiments causing the display of the sender-controlled contact mediacontent data structure on the screen of the at least one mobile deviceis triggered by detection of the passing of the recipient's mobiledevice into an area defined by a geofence.

The methods and systems disclosed herein may include establishing apersonal channel having at least one media item by accessing aninstallable application from the mobile device and selecting at leastone pre-configured menu item that permits access to the at least onemedia item as part of the personal channel. The personal channel mayinclude the at least one media item selected from at least one mediacontent source. The at least one media content source may include atleast one of sender-controlled contact media content received from otherdevices, content available locally on the mobile device, content createdor captured by the mobile device, content obtained from social networkservers, and combinations thereof. The methods and systems disclosedherein may further include sharing the personal channel of the senderwith at least one recipient of the sender-controlled contact mediacontent data structure.

The methods and systems may further include initiating a contact withthe mobile device of the at least one recipient for notifying the mobiledevice of the at least one recipient to provide a media content for useas the sender-controlled contact media content data structure associatedwith the at least one recipient. In some examples, the at least onerecipient may be selected from a contact list or phonebook available onthe sender's mobile device. The methods and systems may enable providinga link to a website to the at least one recipient for uploading somemedia content that may be used as the sender-controlled contact mediacontent data structure associated with the at least one recipient.

Methods and systems are provided herein for establishing a personalchannel of media content items to be displayed on the lock-screen of auser's mobile device in response to a triggering contact event. Thesemay include providing a host system that enables handling of contactmedia content data structures for controlled display of the contactmedia content data structures on the lock-screen of at least one mobiledevice; causing a display of the contact media content data structure ona screen of the at least one mobile device of the at least one recipientwhen the at least one recipient's device is turned on and able toreceive at least one of a data signal and a voice signal, where thecontact media data structure displays media content on the lock-screenof the at least one mobile device upon receipt of a triggering contactevent to the at least one mobile device; and enabling a user toestablish a personal channel of contact media content having at leastone media item by accessing an installable application on the at leastone mobile device and selecting at least one pre-configured menu itemthat designates the at least one media item as part of the personalchannel. In embodiments, the personal channel includes the at least onemedia item selected from at least one media content source, where the atleast one media content source includes at least one of asender-controlled contact media content received from another device,content available locally on the at least one mobile device, contentcreated using the mobile device, and content obtained from a server. Themethods and systems may further include enabling the user to share thepersonal channel with at least one other user of a mobile applicationthat is configured to interact with the host system. The methods andsystems may further include initiating a contact with the mobile deviceof the at least one other user of a mobile device that is configured tointeract with the host system to request that the other user designate acontact media content item to be displayed when the other user initiatesa triggering contact to the user of the at least one mobile device. Inembodiments, the at least one other user is selected from a contact listavailable on the mobile device of the sender. In embodiments, notifyingthe mobile device of the at least one other user includes sending a linkfor a website where the other user is invited to upload the mediacontent to be displayed when the other user initiates a triggeringcontact to the user of the at least one mobile device.

In embodiments, methods and systems described herein may include asystems that may include a lock-screen capable application executing ona recipient computing device, the lock-screen capable devicefacilitating user interface access to a communication function of therecipient computing device while the computing device remains in alocked state, wherein the lock-screen capable application intercepts acommunication received by the recipient device, the communicationassociated with at least one communication application or serviceoperable on the recipient computing device. The system may furtherinclude a content association application executing on the recipientcomputing device, wherein the content association applicationfacilitates associating a content item with the communication, based ona relevance of the content item with the communication, the relevancedetermined from processing the intercepted communication to identify anassociation based on metadata descriptive of content items stored in alibrary of content items. The system may further include automaticallyassociating a content item in response to detecting an indication of anintercepted communication. Automatically associating may includeassociating at least one of a GIF and a video with the communication.Automatically associating may further include determining an emotionalstate of the communication and associating content in response to thedetermined emotional state. Automatically associating may furtherinclude determining a context of the communication and associatingcontent in response to the determined context.

Methods and systems described herein may include a system that mayinclude a sender computing device configured with a sender-controlledcontact media content-based application (SCCMC application), the SCCMCapplication executing on the sender device and interfacing with a senderstate detection application executing on the sender device, wherein thesender state detection application detects at least one of a mood of thesender, a physical status of the sender, an emotional state of thesender and a mental state of the sender, and wherein the SCCMCapplication uses the detected state of the sender to determine an SCCMCstructure that corresponds to the detected state and associatesinformation that identifies the determined SCCMC structure with anoutgoing message for a recipient. In the system, the outgoing message isassociated with a phone call from the sender to a recipient. In thesystem, the SCCMC application further determines a content channelassociated with at least one of the sender and the recipient and basesthe determined SCCMC structure on the determined content channel.

Methods and systems described herein may include a method that mayinclude adapting a sender-controlled contact media content structure inresponse to receiving an indication of a current state of a sender ofthe sender-controlled contact media content structure, wherein the stateis one of a mood, a physical status, an emotional status, and a mentalstatus. In the method, the state is determined in response to facialrecognition of the sender contemporaneously with the sender sending amessage from a sender's computing device to a recipient's computingdevice. In the method, adapting occurs while a recipient computingdevice is processing a contact event resulting from receipt of a messagefrom a sender's computing device.

Methods and systems described herein may include a method that mayinclude operating a sender-controlled contact media content structurecreation platform on a computing device that, in response tointercepting a message being communicated between messaging applicationsresident on a sender's mobile device and a recipient's mobile device,offers customized services of the platform to a user of the mobiledevice on which the message is intercepted. In the method, the messageis intercepted on a sender mobile device prior to the message being sentto the recipient. In the system, the message is intercepted on arecipient mobile device prior to the messaging application resident onthe recipient's mobile device receiving the message. In the system,intercepting includes developing an understanding of the message withnatural language processing, the understanding further used tofacilitate making suggestions for video/image/audio of an SCCMC to beassociated with the message.

Methods and systems described herein may include a method that mayinclude operating a sender-controlled contact media content (SCCMC)structure contact event handling platform. The platform may perform thesteps including intercepting a message associated with other messagingapplications resident on the mobile device, wherein the message istargeted to a first messaging application of the other messagingapplications; processing the message with natural language processing todetermine at least one SCCMC structure; forwarding the determined atleast one SCCMC structure to an SCCMC unified messaging user interface;processing the SCCMC structure with the unified messaging interface;presenting at least one of text and imagery determined from theprocessing of the SCCMC structure in the unified messaging interface;and delivering a message that is compatible with the other messagingapplications to the first messaging application. In the method, themessage is intercepted on a recipient mobile device. In the method, theplatform operation may be performed while the recipient's mobile deviceis locked. In the method, the message is intercepted on a sender'smobile device.

Methods and systems described herein may include a method that mayinclude integrating at least one of audio, video, imagery, and textindicated by a sender-controlled contact media content (SCCMC) structureinto an augmented reality environment in response to detecting amobile-to-mobile device contact event, the integrating indicating thecontact event.

Methods and systems described herein include a lock-screen capableapplication executing on a recipient computing device. The lock-screencapable application is configured to facilitate user interface access toa communication function of the recipient computing device while therecipient computing device remains in a locked state. The lock-screencapable application is configured to intercept a communication receivedby the recipient computing device. The intercepted communication isassociated with at least one of a communication application or acommunication service operable on the recipient computing device. Themethods and systems further include a content association applicationexecuting on the recipient computing device. The content associationapplication is configured to facilitate associating a media content itemwith the intercepted communication based on a relevance of the mediacontent item with the intercepted communication. The relevance isdetermined by automatically processing the intercepted communication toidentify an association based on metadata descriptive of media contentitems stored in a library of the media content items.

In embodiments, the associating of the media content item is performedautomatically by the content association application in response todetecting an indication of the intercepted communication.

In embodiments, the content association application is configured toassociate at least one of a GIF and a video with the interceptedcommunication.

In embodiments, the processing automatically of the interceptedcommunication to identify the association includes automaticallydetermining an emotional state of the intercepted communication andautomatically associating at least one of the media content items inresponse to the automatically determined emotional state.

In embodiments, the processing automatically of the interceptedcommunication to identify the association includes determining a contextof the intercepted communication and associating at least one of themedia content items in response to the determined context.

Methods and systems described herein include a sender computing deviceconfigured with a sender-controlled contact media content-basedapplication (SCCMC application). The SCCMC application is configured toexecute on the sender device and interface with a sender state detectionapplication that executes on the sender device. The sender statedetection application is configured to detect a detected state thatincludes at least one of a mood of the sender, a physical status of thesender, an emotional state of the sender and a mental state of thesender. The SCCMC application uses the detected state of the sender todetermine an SCCMC structure that corresponds to the detected state andassociates information that identifies the determined SCCMC structurewith an outgoing message for a recipient.

In embodiments, the outgoing message is associated with a phone callfrom the sender to a recipient.

In embodiments, the SCCMC application is configured to determine acontent channel associated with at least one of the sender and therecipient and to base the determined SCCMC structure on the determinedcontent channel.

Methods and systems described herein include adapting asender-controlled contact media content structure in response toreceiving an indication of a current state of a sender of thesender-controlled contact media content structure. The current state ofthe sender is one of a mood, a physical status, an emotional status, anda mental status.

In embodiments, the current state of the sender is determined inresponse to facial recognition of the sender contemporaneously with thesender sending a message from a sender's computing device to arecipient's computing device.

In embodiments, the adapting of the sender controlled contact mediacontent occurs while a recipient's computing device is processing acontact event resulting from receipt of a message from a sender'scomputing device.

Methods and systems described herein include operating asender-controlled contact media content structure creation platform on acomputing device that, in response to intercepting a message beingcommunicated between messaging applications resident on a sender'smobile device and a recipient's mobile device, offers customizedservices of the platform to a user of the mobile device on which themessage is intercepted.

In embodiments, the message is intercepted on a sender mobile deviceprior to the message being sent to the recipient.

In embodiments, the message is intercepted on a recipient mobile deviceprior to the messaging application resident on the recipient's mobiledevice receiving the message.

In embodiments, the intercepting includes developing an understanding ofthe message with natural language processing, and wherein theunderstanding is further used to facilitate making suggestions forvideo/image/audio of a sender-controlled contact media content to beassociated with the message.

Methods and systems described herein include operating asender-controlled contact media content (SCCMC) structure contact eventhandling platform including intercepting a message associated with othermessaging applications resident on the mobile device, wherein themessage is targeted to a first messaging application of the othermessaging applications. The methods and system also include processingthe message with natural language processing to determine at least oneSCCMC structure and forwarding the determined at least one SCCMCstructure to an SCCMC unified messaging user interface. The methods andsystems further include processing the SCCMC structure with the unifiedmessaging interface, presenting at least one of text and imagerydetermined from the processing of the SCCMC structure in the unifiedmessaging interface, and delivering the message that is compatible withthe other messaging applications to the first messaging application.

In embodiments, the message is intercepted on a recipient's computingdevice.

In embodiments, the message is intercepted on a recipient computingdevice while the recipient's computing device is locked.

In embodiments, the message is intercepted on a sender's computingdevice.

Methods and systems described herein include integrating at least one ofaudio, video, imagery, and text indicated by a sender-controlled contactmedia content (SCCMC) structure into an augmented reality environment inresponse to detecting a mobile-to-mobile device contact event. Theintegrating of the at least one of audio, video, imagery, and text is anindicator of the contact event.

In embodiments, the methods and systems include adapting thesender-controlled contact media content structure in response toreceiving an indication of a current state of a sender of thesender-controlled contact media content structure. The current state ofthe sender is one of a mood, a physical status, an emotional status, anda mental status.

In embodiments, the current state of the sender is determined inresponse to facial recognition of the sender contemporaneously with thesender sending a message from a sender's computing device to arecipient's computing device.

In embodiments, integrating includes developing an understanding of themessage from the sender with natural language processing, and whereinthe understanding is further used to facilitate making suggestions forvideo/image/audio of a sender-controlled contact media content to beassociated with the message.

BRIEF DESCRIPTION OF THE FIGURES

In the accompanying figures, like reference numerals refer to identicalor functionally similar elements throughout the separate views andtogether with the detailed description below are incorporated in andform part of the specification, serve to further illustrate variousembodiments and to explain various principles and advantages all inaccordance with the systems and methods disclosed herein.

FIG. 1 illustrates an architecture for a method and system for an SCCMCin accordance with an embodiment of the systems and methods disclosedherein.

FIGS. 2A and 2B illustrate a process for creating and sharing an SCCMCin accordance with an embodiment of the systems and methods disclosedherein.

FIG. 2C illustrates a process for initiating a phone call in accordancewith an embodiment of the systems and methods disclosed herein.

FIGS. 3A-3G illustrate the creation of an SCCMC in accordance with anembodiment of the systems and methods disclosed herein.

FIGS. 4A-4F illustrate examples of an SCCMC in accordance with anembodiment of the systems and methods disclosed herein.

FIGS. 5A, 5B, and 5C illustrate User A sharing an SCCMC with User B inaccordance with an embodiment of the systems and methods disclosedherein.

FIG. 6 illustrates User A adding custom details to an SCCMC inaccordance with an embodiment of the systems and methods disclosedherein.

FIG. 7 illustrates User B setting an SCCMC received from User A inaccordance with an embodiment of the systems and methods disclosedherein.

FIG. 8 illustrates User B creating an SCCMC and sharing the SCCMC withUser A and others in accordance with an embodiment of the systems andmethods disclosed herein.

FIG. 9 illustrates an SCCMC created by User B for his or her significantother in accordance with an embodiment of the systems and methodsdisclosed herein.

FIG. 10 illustrates a Home-Feed screenshot of an SCCMC in accordancewith an embodiment of the systems and methods disclosed herein.

FIGS. 11A and 11B illustrate Notifications screenshots of an SCCMC inaccordance with an embodiment of the systems and methods disclosedherein.

FIG. 12 illustrates a Menu screenshot of an SCCMC in accordance with anembodiment of the systems and methods disclosed herein.

FIG. 13 illustrates a Settings screenshot of an SCCMC in accordance withan embodiment of the systems and methods disclosed herein.

FIGS. 14A-14I illustrate screenshots of a process to enable contactediting between users in accordance with an embodiment of the systemsand methods disclosed herein.

FIGS. 15A, 15B, and 15C illustrate screenshots of a process to deliver acontact with an SCCMC that automatically, or under user control, updateson the phone contacts of another user in accordance with an embodimentof the systems and methods disclosed herein.

FIG. 16 illustrates a process for transferring an SCCMC from User A toUser B in accordance with an embodiment of the systems and methodsdisclosed herein.

FIGS. 17A-17D illustrate user community growth of an SCCMC through aviral sharing effect in accordance with an embodiment of the systems andmethods disclosed herein.

FIGS. 18A, 18B, and 18C illustrate monetization examples of an SCCMC inaccordance with an embodiment of the systems and methods disclosedherein.

FIGS. 19-21 illustrate trigger examples of an SCCMC in accordance withan embodiment of the systems and methods disclosed herein.

FIG. 22 illustrates a flow in which a second user's reaction to an SCCMCis recorded and shared with another party.

FIG. 23 illustrates a flow in which the playing of an SCCMC may betriggered by a triggering event.

FIG. 24 illustrates a computer system.

FIG. 25 illustrates a mobile device.

FIG. 26 illustrates a screenshot of a user interface for setting apersonal channel for an SCCMC in accordance with an embodiment of thesystems and methods disclosed herein.

FIGS. 27 and 28 illustrate screenshots of a user interface for enablinga media content based on an identity of a user in accordance with anembodiment of the systems and methods disclosed herein.

FIG. 29 illustrates a screenshot of a user interface for creating avideo for an SCCMC in accordance with an embodiment of the systems andmethods disclosed herein.

FIG. 30 illustrates a flowchart of a method for providing a setup of acontextual video message in accordance with an embodiment of the systemsand methods disclosed herein.

FIGS. 31A-31E illustrate screenshots of a user interface for a messaginginteraction in accordance with embodiments of the systems and methodsdisclosed herein.

FIG. 32 illustrates a block diagram of a unified messaging platform inaccordance with an embodiment of the systems and methods disclosedherein.

FIG. 33 illustrates an embodiment of a media content library inaccordance with an embodiment of the systems and methods disclosedherein.

FIG. 34 illustrates an embodiment of composite media content library inaccordance with an embodiment of the systems and methods disclosedherein.

FIG. 35 illustrates an embodiment of separate media and SCCMC structurelibraries in accordance with an embodiment of the systems and methodsdisclosed herein.

FIG. 36 illustrates an embodiment of a sender device configuration inaccordance with an embodiment of the systems and methods disclosedherein.

FIG. 37 illustrates an embodiment of a unified messaging user interfacefor media content selection in accordance with an embodiment of thesystems and methods disclosed herein.

FIG. 38 illustrates an embodiment of a recipient device configuration inaccordance with an embodiment of the systems and methods disclosedherein.

FIG. 39 illustrates an embodiment of a unified messaging interface forresponding to a modified media content message in accordance with anembodiment of the systems and methods disclosed herein.

FIG. 40 illustrates an embodiment of the system of FIG. 32 furtherincluding speech to text for transcribing audio messages for use withNLP.

FIG. 41 illustrates a flow chart of processing an audio message with anembodiment of the platform of FIG. 40.

FIG. 42 illustrates a flowchart of communicating between a messagingplatform via an API and a content matching platform to recommend hashtags rather than image content.

FIG. 43 illustrates exemplary screens of generating and playing backvisual caller ID.

FIG. 44 illustrates exemplary screens for leaving a video voice mail.

FIG. 45 illustrates a flow for handling unknown callers.

FIG. 46 illustrates post call experience user screens.

FIG. 47 illustrates an architecture and a flow for a call communityfirewall.

FIG. 48 illustrates call participant validation user screens.

FIG. 49 illustrates user screens for saving and playing backvisual/video voice mail.

Skilled artisans will appreciate that elements in the figures areillustrated for simplicity and clarity and have not necessarily beendrawn to scale. For example, the dimensions of some of the elements inthe figures may be exaggerated relative to other elements to help toimprove understanding of embodiments of the systems and methodsdisclosed herein.

DETAILED DESCRIPTION

The present disclosure will now be described in detail by describingvarious illustrative, non-limiting embodiments thereof with reference tothe accompanying drawings and exhibits. The disclosure may, however, beembodied in many different forms and should not be construed as beinglimited to the illustrative embodiments set forth herein. Rather, theembodiments are provided so that this disclosure will be thorough andwill fully convey the concept of the disclosure to those skilled in theart. The claims should be consulted to ascertain the true scope of thedisclosure.

Before describing in detail embodiments that are in accordance with thesystems and methods disclosed herein, it should be observed that theembodiments reside primarily in combinations of method steps and/orsystem components related to enabling a user to associate a service witha product in a way that makes it much more convenient and effective forthe user to take advantage of the benefits of the service in connectionwith the product. Accordingly, the system components and method stepshave been represented where appropriate by conventional symbols in thedrawings, showing only those specific details that are pertinent tounderstanding the embodiments of the systems and methods disclosedherein so as not to obscure the disclosure with details that will bereadily apparent to those skilled in the art.

All documents mentioned herein are hereby incorporated by reference intheir entirety. References to items in the singular should be understoodto include items in the plural, and vice versa, unless explicitly statedotherwise or clear from the context. Grammatical conjunctions areintended to express any and all disjunctive and conjunctive combinationsof conjoined clauses, sentences, words, and the like, unless otherwisestated or clear from the context. Thus, the term “or” should generallybe understood to mean “and/or” and so forth.

Recitation of ranges of values herein are not intended to be limiting,referring instead individually to any and all values falling within therange, unless otherwise indicated herein, and each separate value withinsuch a range is incorporated into the specification as if it wereindividually recited herein. The words “about,” “approximately,” or thelike, when accompanying a numerical value, are to be construed asindicating a deviation as would be appreciated by one skilled in the artto operate satisfactorily for an intended purpose. Ranges of valuesand/or numeric values are provided herein as examples only and do notconstitute a limitation on the scope of the described embodiments. Theuse of any and all examples, or exemplary language (“e.g.,” “such as,”or the like) provided herein, is intended merely to better illuminatethe embodiments and does not pose a limitation on the scope of theembodiments or the claims. No language in the specification should beconstrued as indicating any unclaimed element as essential to thepractice of the embodiments.

In the following description, it is understood that terms such as“first,” “second,” “third,” “above,” “below,” and the like, are words ofconvenience and are not to be construed as implying a chronologicalorder or otherwise limiting any corresponding element unless expresslystate otherwise.

As used herein, the term “tone” may be used to refer to a singleinstance of a sender-controlled contact media content type, which mayinclude one or more of audio, video (which may include video captured byvideo cameras, voice, computer-generated video, animations, or othervideo-type content that can be displayed in any format on a mobiledevice, such as a mobile phone), contact data, and/or metadata. A singletone may be adapted for broadcast, in a single act by a sender, overboth voice layer and data layer transmission mediums in a coordinatedfashion. As noted above, an SCCMC is also referred to herein (includingin the figures) for convenience as a “Vyng,” which is an example of abrand name for the SCCMC that would be understood by users to refer tothis novel type of content item.

FIG. 1 illustrates an embodiment of an architecture 100 for an SCCMC.The architecture 100 includes a user A's mobile phone 102, referred toalternatively herein as a sender mobile phone 102. The architecture 100further includes a user B's mobile phone 104, alternatively referred toas a recipient mobile phone 104. The sender mobile phone 102 andrecipient mobile phone 104 are each communicatively connected with acontent server 112. The architecture 100 may run an application(referred to herein in some cases as the App) that may establish a dataconnection, or tunnel, between the two user's phones and may controlcreation and display of SCCMC-type content between the two devices 102and 104. The architecture 100 and the SCCMC-type content data structuremay be used with any type of mobile device or mobile device operatingsystem or platform, such as the Android™ operating system, the iOS™operating system, or other operating systems. Embodiments providedherein that describe a particular operating system should be understoodto apply to other operating systems, except where the context indicatesotherwise (such as where a particular operating system lacks thefunctions described in connection with a particular embodiment). Inaddition to using and integrating with mobile operating systemplatforms, the architecture 100 and SCCMC-type content items may beintegrated with and layered within other applications, including onesthat host developer platforms, such as Facebook Messenger™ and Viber™.Integration with apps that have calling features, including ones thatuse Voice over IP allows for the SCCMC-type content item to leverage theplatforms that support such applications, including to produceSCCMC-type content items to be delivered upon incoming calls. This maybe accomplished, among other things, by use of the developer platformresources that are associated with such applications, such as developeruser interfaces, application programming interfaces, developer tools,and the like, including integration of the content server 112 describedin connection with the architecture 100.

FIG. 2A illustrates a process for creating and sharing an SCCMC tone(referred to in some cases simply as a “tone”). First, the architecture100 may enable a user interface on the sender mobile phone 102 to allowthe sender to create video and/or audio content, or an SCCMC tone, atstep 1. The user may edit the audio and/or video content from externalsources (e.g., stored in the cloud or from a library of a third-partycontent provider), internal sources (e.g., from saved audio/video on thephone), or may create new video/audio. The user may set privacy controlsvia the App to limit publication of the SCCMC tone to a select audience.

The user's composite creation may be separated into audio, video, andmetadata components. These components may be associated with aparticular tone, such as by being assigned as properties of the tone.The tone may then be stored locally on the device 102. The tone may beuploaded to the application server or content server 112 and may bepersisted in storage, such as associated with the server 112 or incloud-based storage.

In an exemplary embodiment, a first user may create the SCCMC such asusing the App at step 1. At a step 2, the first user may then share theSCCMC with friends, such as by text/SMS message (such as in a snippet,link, or the like in a text) such as with a second user. At a step 3,the first user may preview the SCCMC and/or add other custom details,either before or after sharing the SCCMC with one or more other users.At a step 4, the second user may tap the link and install the App, whichmay set the SCCMC of the first user on the second user's phone 104.Either user may send the SCCMC to multiple persons, and a communityaround the App may be used, such as within a group of friends, within aschool district, within a workgroup or enterprise, or the like. When thesecond user first downloads the App, the first user's contact may beshown now associated with the SCCMC tone created by the first user. Thesecond user may further create a tone at a step 5A. At a step 6, thesecond user may share this SCCMC with the first user and/or otherfriends, for example. The second user may, for example, create a customSCCMC for his spouse at a step 5B.

FIG. 2B illustrates a process 200 for creating and sharing an SCCMC tone(referred to in some cases simply as a “tone” or in other cases as a“Ving” or a “Vyng”). First, the architecture 100 may enable a userinterface on the sender mobile phone 102 to allow the sender to createvideo and/or audio content, or an SCCMC tone, at step 202. The user mayedit the audio and/or video content from external sources (e.g., storedin the cloud or from a library of a third-party content provider),internal sources (e.g., from saved audio/video on the phone), or maycreate new video/audio. The user may set privacy controls via the App tolimit publication of the SCCMC tone to a select audience.

The user's composite creation may be separated into audio, video, andmetadata components. These components may be associated with aparticular tone, such as by being assigned as properties of the tone.The tone may then be stored locally on the device 102. The tone may beuploaded to the application server or content server 112 and may bepersisted in storage, such as associated with the server 112 or incloud-based storage.

In an exemplary embodiment illustrated in FIG. 2B, a first user maycreate the SCCMC such as using the App at the first step 202. The SCCMCmay be created using a standard encoding protocol. Standard encodingprotocols may include HTML5, Flash, MP4/H.264, WebM, Ogg, 3GP/MPEG4 andthe like. At a second step 204, the first user may upload the SCCMC to aserver. The server may be a hosted on a cloud hosting service. Cloudhosting services may include Amazon Web Services™ (AWS), Microsoft AzureInfrastructure Services™, Google Cloud Platform™, CenturyLink Cloud™(CLC), VMware vCloud Air™ IBM SoftLayer™, Rackspace™ and the like.

At a third step 208, a dual push notification may be sent from theserver to a second user. The dual push notification may be sent over afirst network 220, a second network 222, or a first network 220 and asecond network 222. First network 220 and second network 222 may be onseparate infrastructures operated by different operators, such as anAmazon™ SMS infrastructure, a Google™ Cloud Messaging infrastructure, aPushy™ MQTT infrastructure, an infrastructure of a mobiletelecommunications operator, and the like. Sending the push notificationover multiple, separate infrastructures may increase the reliability ofthe push notification sent from the first user being received by thesecond user.

At a fourth step 210, the second user may receive the push notificationon the second user's mobile phone 104. The push notification may includeinformation that tells the second user's mobile phone 104 to prepare toplay the SCCMC created by the first user. The second user's mobile phone104 may download the SCCMC. The SCCMC may be installed on the seconduser's mobile phone 104 to be played on a screen of the second user'smobile phone 104, such as at the lock screen, on the home screen, in anapplication, or on a screen that displays while the recipient is on aphone call. At a fifth step 212, the second user may send a pushnotification to the first user. The push notification sent by the seconduser to the first user may inform the first user that the second userreceived the SCCMC sent by the first user. The push notification sent bythe second user to the first user may also inform the first user thatthe SCCMC sent by the first user to the second user is ready to play onthe second user's mobile phone 104.

FIG. 2C illustrates a process and flow 228 for initiating a phone call.A phone call may be initiated when a first user receives a pushnotification from a second user, as illustrated in the first step 238.In a second step 240, the first user may initiate a phone call from thefirst user's mobile phone 102 to the second user's mobile phone 104. Thephone call may be initiated over a voice network 230, a data network232, or both, and may be associated with a message from the sender to arecipient. In embodiments, the call may use both transmission layers(voice and data). A voice network 230 may be a cellular phone network. Aphone call initiated over a data network 232 may be a voice overInternet protocol (VOIP) phone call. A VOIP phone call may be initiatedwith a second push notification sent from the first user to the seconduser. A second push notification may include a session ID. A VOIP callmay be initiated using a third-party service. A third-party service maybe provided by Top Box™, Skype™, Google Hangouts™ WhatsApp™, WeChat™ andthe like.

The second user may receive the phone call on the second user's mobiledevice 104 from the first user's mobile device 102 at a third step 242.The second user's mobile device 104 may play the SCCMC when the phonecall is received from the first user's mobile device 102, as illustratedin subsequent steps 244 and 248.

FIGS. 3A-3G illustrate detailed screenshots of a user interface of theApp by which a first user may create a new SCCMC. The first user maycreate the SCCMC with custom ringtones, text tones, and photo as part ofhis or her contact card that may be controlled by the first user himselfon his or her friend's phone (recipient mobile phone 104) instantly. TheApp may provide interfaces for getting started with the App, brieftutorials, the capability for recording videos, the ability to selectfriends, the ability to push videos to other people's phones, and thelike. Ideas may be provided as prompts to the user. The App may allowcreating and sharing of videos and tunes. The App may allow listening toor viewing other ringtones that have already been created. The App mayallow creating the first SCCMC for a user. The App may also allowvarious video options, such as slow motion, the use of a timer, and thelike, to be included in or with the SCCMC. The App may allow the user toedit a page and/or request additional tools or advanced features. In anexample, the source file may be removed and the App may keep the videoand play something else for audio and/or split the video and audio andchange either one. The App may allow adding filters, captions, messages,or music, customization of the message, and the like. The App may allowsharing a page to a list of friends and the like. The App may allowsharing through a text message, such as via a button that allows theuser to send a preview of the SCCMC with video and/or audio and a linkto download the App. The App may enable a store for downloading the Appif it is not already installed on the phone of the recipient. If thesecond user has an App, a message may trigger delivering the SCCMC toneto a queue.

For purposes of creation, a button in the App may allow the first userto discover and choose audio, videos or SCCMC tones that he may alreadyhave. The videos or other forms of content to be used in the SCCMC maybe stored in a library, and the App may facilitate discovery from thelibrary. The App may also allow browsing other videos that come fromother websites that enable sharing or downloading of video. Inembodiments, the SCCMC may be selected from a curated library ofSCCMC-type content. The library may be automatically curated, undercomputer control, via an algorithm that is based on a topic of interestindicated by a sender or a recipient of an SCCMC. The library may becurated by an editor based on subject matter, such as the subject matterof a channel to which a sender or recipient subscribes.

The App may allow searching for keywords, and it may automaticallyupload a video that is searched for those keywords. The App may alsoallow using stop-motion photos in the SCCMC and may allow video or audiopayload. The App may allow adding audio to videos, and the like. Theaudio files may be either taken from what is already created (user'slibrary), or from the sender mobile phone 102, or from other users,albums (such as music store), and the like.

FIGS. 4A and 4B illustrate a call being received on a second user'smobile device 104. The call may display the SCCMC tone created by thefirst user automatically on the second user's phone. In embodiments, thefirst user may wish to convey a current emotional state. A userinterface on the first user's phone may, for example, allow the firstuser to create multiple tones, each of which is associated with anemotional state. The emotional states may be indicated in metadata ofthe tones. When the user initiates a call, the user may indicate acurrent emotional state, which, when transmitted to the phone of thesecond user, may initiate a process by which the App selects anddisplays the correct SCCMC tone that is associated with that currentemotional state of the first user. The emotional state may be conveyedby a facial expression, an image, a sound, an emoticon, or othercharacteristic associated with a particular tone.

As shown, the recipient mobile phone 104 may display the SCCMC that thefirst user directs the recipient mobile phone 104 to ring/show videothat reflects the current mood of the first user. The App may be able tochoose what the first user sends, or what message is displayed on thesecond user's phone, such as indicated by emojis, by selecting a mood,or the like. In embodiments, the correct SCCMC tone may be associatedwith and therefore shared every time the first user calls or texts thesecond user. In other embodiments one or more tones is stored on thesecond user's mobile device 104 and is triggered by the receipt of acall from the number of the first user's device 102, possibly carryingwith it other information (which may be transmitted over the server 112via the App) that allows selection of particular emotional content. Inembodiments, the App may change an SCCMC during a call. The App may betriggered to change an SCCMC during a call when the mood of the firstuser changes to a different mood, for example. The App may select a newSCCMC for display on the second user's device 104 to reflect thedifferent mood of the first user. A user may be able to respond to theSCCMC.

A user may be able to respond to an SCCMC by tapping on the SCCMC. Forexample, a second user may be able to provide feedback to a first useron an SCCMC sent by the first user to the second user. The feedback sentby the second user may indicate the second user's satisfaction with theSCCMC sent by the first user to the second user. The second user mayprovide feedback to the first user by tapping on an SCCMC received froma first user, for example. The tap may generate a heart or other emojion the SCCMC displayed on the second user's mobile device 104. The tapmay also generate a heart or other emoji on the screen of the firstuser's mobile device 102.

FIGS. 5A-5C illustrate embodiments of user interface features by whichthe first user may share an SCCMC tone with the second user. FIG. 5Aillustrates a message that the second user may receive from the firstuser, prompting the second user to accept delivery of and set the SCCMCtone of the first user on the mobile device of the second user. Themessage may include text, video, audio, links, and the like. FIG. 5Billustrates a detailed screenshot of the interface by which a first usermay select which friends the first user would like to have received theparticular SCCMC tone. FIG. 5C illustrates a confirmation that may bedisplayed to the first user when the SCCMC has been successfully sharedwith the selected friends of the first user.

In various embodiments, content delivery may be achieved either througha client-server architecture (including a cloud architecture), apeer-to-peer architecture, or other content delivery architecture.

In a client-server approach, the App may periodically query theapplication server or content server 112 for newly published or updatedcontent. A content update may also be triggered via a push message fromthe server 112. Content may be filtered based upon privacy settings setby the content creator. The App may automatically download newlypublished or updated content and may synchronize the local data store onthe device 102 with other content, such as cloud-stored content.

In a peer-to-peer approach, users, such as the first user and the seconduser in the examples above, who are in proximity to each other orconnected via any peer-to-peer network connection may discover eachother through the App. For example, the peer application may broadcastits presence to a listening port on the other peer device to establishits presence and seek to exchange credentials. Once discovered, peersmay be displayed in the App to a user. The user may then selectivelysend SCCMC tones to one or more discovered peers.

FIG. 6 illustrates a detailed screenshot of a user interface by which auser may record audio for inclusion in or with an SCCMC tone.

FIG. 7 provides a detailed screenshot of an interface by which a usermay see snapshots of various SCCMC tones, such as ones received fromother users or ones created to be shared with other users. When the Appis installed on the phone of a user, the phone number of the user may beverified. Verification may be done in the background, such as when thephone is running the Android operating system. The App then may use thephone number to automatically set any SCCMC tones that are shared withthe user by any friends of the user who are listed in the contacts onthe phone of the user. The SCCMC tones may be set automatically byseamlessly matching the phone number associated with the SCCMC tone tothe phone number of a contact in the address book on the phone of theuser. Once the App is installed on the phone of a user, any new SCCMCtones sent to the user may be automatically set and a notification maybe displayed in the notification list of the phone. SCCMC toneacceptance by the user may be automatic, may be active and require inputfrom the user, and the like. SCCMC tone acceptance may be controlled bythe user in the settings of the phone or of the App.

In embodiments upon initiation of the application on a mobile device102, 104, the App may register with the operating system of the mobiledevice, including registering as a listener for incoming voice calls andincoming text messages.

When the App is notified of an incoming call, it may receive theincoming phone number from the operating system. The App may query itsown internal database for an SCCMC tone that is linked to the incomingphone number. If a match is found, the App starts a new activity to playthe SCCMC tone, such as using the default ringer application on thephone.

When the App is notified of an incoming text message (SMS), it mayreceive the incoming phone number from the operating system. The App mayquery its own internal database, such as for audio to play that islinked to the incoming phone number. If a match is found, the App mayplay the audio file, such as in an alternative to playing the defaultsound normally used to indicate an incoming text message.

The App may further allow pushing and synchronizing content to thecontacts portion of a friend's/contact's phone, such as the recipientmobile phone 104, where the first user may control the video/audiopresentation when the recipient mobile phone 104 rings upon the call ofthe first user. In embodiments, a user may find, manipulate and/orcreate video and/or audio and push it to the contacts function onsomeone else's phone, such as the recipient mobile 104.

FIGS. 8 and 9 illustrate examples of an SCCMC tone being displayed onthe mobile phone 104 of the user as the user receives a call fromsomeone who created and sent an SCCMC tone to the user.

FIG. 10 illustrates a “Home-Feed” interface screenshot. The interfaceallows a user to see what he or she has downloaded and what he or shehas shared with another user. The interface may allow a user to “like”or comment on the SCCMC tone. The interface shows what is pending in thenews feeds of the user. The interface may also show updates in the SCCMCtone by other users.

FIGS. 11A and 11B illustrate screenshots for displaying notifications. Auser may receive notifications via one or more push messages sentthrough the mobile operating system of the phone of the user. Asillustrated in embodiments shown in FIGS. 11A-11B, a user may accessnotifications via a notification icon 1102 displayed in the App. The Appmay enable a communication channel between the first user and his or herclose contacts, including the second user, so that the first user andhis or her friends may have an automatic update channel. For example, asshown in FIG. 11A, Joe may have updated his SCCMC tone and shared theupdate with a second user over the communication channel. As an example,the first user may change audio and video associated with the SCCMC tonethat the first user shared with the second user. The App may reflectchanges in the user profile of the first user on the phone of the seconduser and notify the second user of the changes in the notificationsinterface of the phone of the second user. The changes may reflect achanged text (e.g., audio) tone, changed SCCMC tone, and the like.

In the illustrated embodiment shown in FIG. 11A, the first user not onlycreated a video ringtone but also created a text tone. The App changesthe text tone accordingly.

Embodiments may include user linking. For example, the first user andthe second user may link their accounts so that shared content isavailable between the users. The first user may send a text message withan identifying token via the App to the second user. The App on therecipient's phone 104 may listen for the incoming text message andautomatically send the identifying token to the server 112. The twoaccounts are then linked server-side so that content may be sharedbetween the first user and the second user.

User discovery may also be enabled. The App may also display a feed ofpublicly shared tones. The users may discover and link their accounts toother users in the public feed via private request/accept messages.Users may “like” a tone, add a tone to their library (re-Vyng), commenton a tone, report a tone and the like. A record button may be fixed tothe bottom of the feed screen. Video may play without audio as a userscrolls through the feed. Users may maximize the video by tapping on it,and when the video is maximized the accompanying audio may be played.

FIG. 12 illustrates a “Menu” screenshot. The user may access a homescreen, a list of tones (referred to as “Vyngs” in FIG. 12), a list ofthe user's friends, and other settings from the “Menu”.

FIG. 13 illustrates a Settings screenshot. Various settings options maybe provided to allow the second user to set allowances for his or hercontacts e.g., preview tones before they automatically update on therecipient mobile 104.

FIGS. 14A-14I illustrate various screenshots for the process to enablecontact editing between the first user and the second user using anSCCMC tone. A channel is provided to enable contact editing between thefirst user and the second user. The edits made by the first user to thecontact provided to the second user may be done automatically or undercontrol of the first user, the second user or the first and second user.A user may allow an SCCMC to be saved, synchronized, or automaticallyupdated.

The first user may go into a payload that the first user sends to thesecond user. The first user may put content in the form of a profilepicture, name, and email into the payload. If the first user changes anyof this content, then the second user receives an update (e.g., thefirst user changed his or her profile picture, email, etc.) that mayautomatically update the content on the recipient's phone 104, or therecipient may have settings that control updates to the recipient'sphone, such as by allowing the payload to be updated under control orautomatically, based on the settings selected by the recipient.

The SCCMC tone created for the first user may be shared with the seconduser, the world, or other people selected by the first user. The firstuser may decide to not share the SCCMC tone.

The first user may choose to select existing video or audio to add tothe SCCMC tone as shown in FIGS. 14E and 14F, newly captured audio asshown in FIGS. 14G and 14H, and music as shown in FIG. 14I. Newlycaptured audio may be captured and posted automatically.

In an example, an SCCMC tone may live on the recipient's phone 104 atthe level of the contacts function, rather than in an application thatthe second user has to locate, access, and use. The contact card maycreate all the features of the SCCMC tone using content taken from thesocial network of the first user. If the first user calls or texts thesecond user, the SCCMC displays the contact of the first user, wheneverthe second user uses the normal functions of the phone 102 to interactwith the call or text from the first user. Thus, the SCCMC tone isplayed within the contacts function of the recipient's phone, withoutrequiring the recipient to interact with an application.

FIGS. 15A, 15B, and 15C illustrate screenshots providing the process todeliver a contact with an SCCMC tone that then automatically, or underuser control, updates on the phone contacts of another user. FIG. 15Aillustrates a screenshot providing an interface that may allow a firstuser to select with whom the first user wishes to share the SCCMC tone.The first user may choose to share the SCCMC tone publicly, for examplewith the world, with all friends or with selected friends. FIG. 15Billustrates a screenshot providing an interface that may allow a seconduser who receives the SCCMC from the first user to enable or disable theSCCMC. FIG. 15C illustrates a screenshot providing an interface that mayallow the second user to edit the SCCMC received from the first user andcontrol the behavior of the SCCMC on the phone of the second user.

Various content control functions may be enabled. When the App receivesnew or updated SCCMC tone information, the App may update the localstore of metadata in the application database and update the localcontact information of the registered user with fields stored in a datarecord for the SCCMC tone. The App may also convert the ringtone audioportion of the SCCMC tone into an acceptable format for a ringtone ortext tone on the local device, save the ringtone to the shared datastore in the phone's operating system, and register the ringtone withthe operating system. Using application programming interfaces (APIs) ofthe operating system, the App may assign the ringtone to the sender onthe recipient's phone 104.

FIG. 16 depicts steps of a method for enabling delivery of an SCCMC tonefrom the first user (User A) to the second user (User B), according toan embodiment. First, in a step 1602, the first user, referred to hereinas User A, may save audio and video captured during creation of theSCCMC tone, which may include audio and video captured by a video cameraof the user's phone, audio and/or video retrieved from saved files,and/or video and/or audio retrieved from other sources, such as found ina search, retrieved from storage (including in the cloud), or the like.Next, in a step 1604, the audio and video may be separated into twoseparate files, one for audio and one for video.

Next, in a step 1606, the files may be associated with a database recordthat may store information about the SCCMC tone, such as the identifyinginformation for User A, identifying information and property informationfor the audio file and the video file, and metadata, such as furtherinformation about user A and information about how User A wishes toshare the SCCMC tone. At a step 1608, the SCCMC tone may be uploadedfrom User A's mobile phone 102, such as a smartphone, to a contentserver 112, and at a step 1610 the content server 112 may publish theSCCMC tone along with certain privacy controls that are based onpreferences of User A, such as whether the SCCMC tone is just for UserA, is intended to be shared with another party (referred to here as UserB or the second user) or parties, or is intended to be public. Suchprivacy controls for a given SCCMC tone may be captured in theapplication that User A uses on User A's device to create and upload theSCCMC tone.

Next, at a step 1612, User B may open the App on User B's mobile phone104, which queries the content server 112 to assess what is available toUser B's mobile phone 104 in a feed that is associated with User B,which may include User B's own creations, content shared with User B byothers (such as User A), and public content published by various users.The content server 112 and User B's mobile phone 104 may undertake asynchronization process at step 1614, where a difference is determinedbetween the available feed on the content server 112 and the contentalready on User B's phone, after which at a step 1616 User B's mobilephone 104 downloads any content not already present on User B's phonefrom the content server 112. Once the updated SCCMC tone data isdownloaded, the SCCMC App on User B's mobile phone 104 may turn theaudio file portion of the SCCMC tone into a ring tone at step 1618,which is a special class or format that typically has its own registryin mobile operating systems, such as the Android™ or iOS™ mobileoperating systems, deployed on certain smartphones. At step 1620, theSCCMC App may register the audio file associated with the SCCMC tone inthe ringtone registry as a ringtone. Next, at a step 1622, the SCCMCtone may set up a listener, using the feature of the operating systemthat enables listening for incoming phone calls (which in the case ofdevices running the Android™ mobile operating system is enabled by anSDK for the operating system). The SCCMC App may access native APIsexposed by the Android™ iOS™ or other operating systems to listen for acall. At a step 1624, if an incoming call is detected from a number(e.g., the number of User A) that has a tone associated with it on UserB's mobile phone 104, the SCCMC App retrieves the audio and/or videofile portions of the SCCMC tone that was downloaded and the audio fileportion and video file portion may be played individually or together.

In some closed operating system environments, one cannot detect anincoming phone call or set the user's ringtone for the user. In suchcases, the content server 112 may just update contact information onUser B's mobile phone 104, such as allowing User B to save an SCCMC tonefor calls from User A, but in such cases possibly requiring actions forUser B that are not needed in other situations. In embodiments, thecontent server 112 may also push notifications to users, so that User Bmay view User A's content that was shared for User B.

In embodiments, such as involving closed operating systems, an SCCMCcontent tone may be downloaded and stored on User B's mobile phone 104for later access, such as at a time when the operating system makesavailable the ability to listen to a call, or at such time as the userelects to have the phone “jailbroken” or otherwise made open.

In embodiments, other ways to share content may involve the P2P transferof an SCCMC tone, optionally with separated audio and video components,directly from a phone of a first user to a second user, withoutrequiring a content server 112 or client-server arrangement, or with thecontent server 112 supplying a complementary role, but not beingrequired for the transfer of the SCCMC. This may include using theAirdrop™ function in phones that use the iOS™ operating system orsimilar P2P transfer functions in other operating systems, such asAndroid™

FIGS. 17A-D illustrate a user community growth through viral sharingeffects. FIG. 17A illustrates a first user who has created an SCCMCtone. FIG. 17B illustrates the first user sharing the SCCMC tone with afirst set of recipients. As illustrated in FIG. 17C, upon receipt of theSCCMC tone from the first user, the first recipients create and sharetheir own SCCMC tones with a second set of recipients and the first setof recipients become users of the SCCMC tones in the process. FIG. 17Dillustrates the second set of recipients then sharing their own SCCMCtones with a third set of recipients, as the second set of recipientsbecome users of the SCCMC tones in the process, continuing the growthcycle.

FIGS. 18A, 18B, and 18C illustrate monetization examples. FIG. 18Aillustrates built-in advertising opportunities made available by arecipient of an SCCMC tone asking the sender of the SCCMC how sendercreated/used/shared a sender-controlled SCCMC. FIG. 18B illustrates apremium sender-controlled SCCMC tone as posted on a content feed. Apremium SCCMC tone may support content taken from a marketplace forcontent creators. The marketplace for content creators may include SCCMCtone creation add-ons and brand promotional content. Brand promotionalcontent be directly uploaded to the marketplace by brands and mayinclude brand songs.

A creator of an SCCMC may select content from the marketplace to includein the SCCMC that the user is creating. A creator of an SCCMC may selectcontent from a content library that is made available by the marketplaceto the creator of the SCCMC. The marketplace may make available SCCMCcontent add-ons, which may include voice manipulation functions, photofilters, video filters, and the like. A premium SCCMC may also includepromotional content for brands. An affiliate code may be linked to anSCCMC or a particular content component, such as an audio or video file,included in an SCCMC. Content may be ranked, rated, shared, liked, orsubscribed to by content creators, content senders, or contentrecipients.

FIG. 18C illustrates an example of advertising in a sender-controlledSCCMC, in which an advertisement is displayed to a second user when afirst user calls or sends a text message to a second user. Anadvertisement may include image components, audio components, videocomponents, and the like.

In another example, a sender of an SCCMC tone may associate a song withan SCCMC tone and choose to have that song play on the mobile device ofa recipient when the sender calls or sends a text message to thatrecipient. The song may be a song performed by a favorite artist,another favorite song, and the like. In yet another example, apre-recorded message from a celebrity personality may play on the phoneof a recipient of an SCCMC tone when the sender of the SCCMC tone callsor sends a text message to the recipient. The pre-recorded message maybe selected based on how the recipient chooses to interact with the callor text message by either accepting, rejecting, or replying to the callor message.

FIG. 19 illustrates flow 1900 in which an SCCMC that may be triggered toplay by the sending of an SCCMC from a user to a friend or group offriends. In the example illustrated in FIG. 19, a first user may send anSCCMC to a group of friends, shown in this example as a second user, athird user and a fourth user, as illustrated in first step 1902. In asecond step 1904, the second user, third user and fourth user mayreceive the SCCMC from the first user. In a third step 1906, the SCCMCmay play immediately on the screen of the second user's mobile phonewhen the SCCMC is received on the second user's mobile phone, the screenof the third user's mobile phone when the SCCMC is received on the thirduser's mobile phone and the screen of the fourth user's mobile phonewhen the SCCMC is received on the fourth user's mobile phone. An SCCMCthat may be triggered to play by the sending of an SCCMC from a user toa friend or group of friends may be referred to as a “Vyng Bomb,” insome cases. It may be noted that the SCCMC may be delivered, asdescribed in connection with FIGS. 2B and 2C, over transmission layersof voice and data networks, so that user 2 may receive the SCCMC over adata network and play it upon initiation of a VOIP call, while user 3may receive the SCCMC over a voice network, such that the SCCMC tone isplayed on the screen of user 3's phone when the call is received. Inembodiments, the trigger to play the SCCMC may comprise a pushnotification over a data network without involving a phone call. TheSCCMC may, in such embodiments, play and immediately disappear withoutthere ever existing a phone call or a VoIP call.

FIG. 20 illustrates an SCCMC that may be selected from a set of videocontent. In a first step 2002, a first user may sign up to receivecontent from one or more video channels 2012. Video channels 2002 may beselected from social graph video sources 2014 or other video sources2018, such as libraries curated by editors or curated automatically,such as by one or more algorithms that identify, and aggregate contentbased on, for example, a defined topic of interest. Social graph videosources 2014 may be created in the SCCMC App or found in other apps fromthe social graph of a user, such as videos from Facebook™, Twitter™,LinkedIn™ SnapChat™, Periscope™ and the like. Other video sources 2018may include local sports team video sources, world news video sources,trending videos in categories video sources, top music video sources andthe like. Local sports team video sources may include the latesthighlights from local teams, the favorite teams of the first user andthe like. World news video sources may include the latest world news.Trending videos in categories video sources may include trending videosin a category such as “cats,” for example. Top music video sources mayinclude clips of trending music videos. Once a user has signed up, in asecond step 2004, the first user may receive a call. In a third step2008, a video channel may be selected after the first user receives acall. In a fourth step 2010, a video from the video channel selected inthe step 2008 may play on the screen of the first user's mobile phone.In embodiments, in addition to or as an alternative to the user's socialgraph, there may be one or more private or closed-network channels 2019that users may create and into which they may add their own videos.These private channels 2019 may be made available by invitation (andoptionally closed to uninvited users). For example, there may be achannel # UCLA where only students who attend the university receivepermission to view and participate video content within the channel,such as, in embodiments, via some combination of invitation, password,and location (such as by use of a geofence relating to a location of theuniversity).

In the various embodiments described throughout this disclosure, anSCCMC may also be a live look video. A live look video may allow asecond user to receive a live look at first user, when a first usersends an SCCMC or otherwise initiates a call to a second user. A livelook may allow the second user to immediately see the face of the firstuser upon receipt of the SCCMC from the first user or notification thatthe first user is calling the second user. The live look video may playon the screen of the device of the second user, such as the lock screen,home screen, or other screens. A live look video may be generated byinitiating a live video stream. A live video stream may be initiatedusing a live video stream generator. A live stream generator may be anapplication, such as Skype, Facetime, Periscope, or the like. A livevideo stream may also be recorded and sent as a series of small videosegments. A live look video may be viewed through the window that anSCCMC app has opened on the screen of a user's mobile phone.

Sending an SCCMC may include automatically recording a user's reactionto an SCCMC, as illustrated in FIG. 21. In a first step 2102, a firstuser may send an SCCMC to a second user. The second user may receive theSCCMC from the first user in a second step 2104. The mobile phone of thesecond user may record the reaction of the second user in a third step2018, such as by having the SCCMC include instructions to turn on thecamera of the recipient's phone facing in the direction of therecipient. At a fourth step 2110, the recipient's phone may turn on thecamera and record the reaction of the recipient. In embodiments, thesecond user may give permission to the second user's mobile phone torecord the reaction of the second user. Permission may be given by thesecond user to the second user's mobile phone to record the reaction ofthe second user prior to receipt of the SCCMC, upon receipt of theSCCMC, before the SCCMC begins to play and the like. In a step 2112, therecipient user may be offered options to process the reaction, such asbeing given an option to save, upload or share the second user'sreaction.

FIG. 22 shows an alternative embodiment of a flow for obtaining areaction to an SCCMC. After the sender sends the SCCMC in a step 2202,the recipient receives the SCCMC at a step 2204, and the recipient'sphone records the recipient's reaction at a step 2208, the recipient maybe given an option at a step 2210 to save, upload, or share thereaction, such as with the sender, with the social circle of therecipient, or otherwise, including the option to store the reaction asan SCCMC, such as in a library of SCCMC content.

FIG. 23 illustrates a flow in which the playing of an SCCMC may betriggered by a triggering event, such as entry of a recipient's mobiledevice into a location, such as defined by a geofence. At a step 2302,the location of the recipient's device may be detected at a location,such as defined by a geofence (or otherwise detected at a locationaccording to various location systems known to those of skill in the artof mobile telecommunications). The geofence may surround, by way ofexample, a point of interest, such as a location within a museum, park,or exhibit, a store or other location relevant to promotion or sale ofproducts or services, an educational location within a school, college,or university, or any other location for which there may be relevantcontent that may be presented via an SCCMC. Upon detection at the step2302, an SCCMC may be retrieved at a step 2304, such as from a libraryof SCCMCs. This may include retrieving content that is associated withthe location (such as content about a nearby museum exhibit or a nearbyproduct) and may include retrieving content relevant to the recipient(such as content relating to that recipient's preferences, as indicatedby selection of channels, by reactions to particular content, by therecipient's preferences as indicated by other data sources (such aspurchases, interactions with content, or the social graph of therecipient), or the like. An SCCMC may be retrieved based in part onwhether the recipient has visited the location before (information whichmay be stored by the host system or stored locally at the computinginfrastructure for a geofence), so that the SCCMC may be varied forrepeat visitors. The content server may retrieve an appropriate SCCMCand, at a step 2308, send it to the recipient's mobile device. Then theSCCMC may play on the device 2310 as described in connection withvarious embodiments described throughout this disclosure.

FIG. 24 illustrates a computer system, e.g., a computer system that maybe used in conjunction with the devices, systems, and methods describedherein. In general, the computer system 2400 may include a computingdevice 2410 connected to a network 2402, e.g., through an externaldevice 2404. The computing device 2410 may be or include any type ofclient or other network endpoints as described herein, e.g., a mobiledevice as described throughout this disclosure. The computing device2410 may also or instead be any device suitable for interacting withother devices over a network 2402, such as a laptop computer, a desktopcomputer, a personal digital assistant, a tablet, a mobile phone, atelevision, a set top box, a wearable computer, and the like. Thecomputing device 2410 may also or instead include a server such as anyof the servers described herein.

In certain aspects, the computing device 2410 may be implemented usinghardware (e.g., in a desktop computer), software (e.g., in a virtualmachine or the like) or a combination of software and hardware. Thecomputing device 2410 may be a standalone device, a device integratedinto another entity or device, a platform distributed across multipleentities, or a virtualized device executing in a virtualizationenvironment.

The network 2402 may include any network described above, e.g., datanetwork(s) or internetwork(s) suitable for communicating data andcontrol information among participants in the computer system 2400. Thismay include public networks such as the Internet, private networks, andtelecommunications networks such as the Public Switched TelephoneNetwork or cellular networks using third generation cellular technology(e.g., 3G™ or IMT-2000™), fourth generation cellular technology (e.g.,4G™, LTE™. MT-Advanced™, E-UTRA™, etc.) or WiMAX-Advanced™ (IEEE802.16m)) and/or other technologies, as well as any of a variety ofcorporate area, metropolitan area, campus or other local area networksor enterprise networks, along with any switches, routers, hubs,gateways, and the like that may be used to carry data among participantsin the computer system 2400. The network 2402 may also include acombination of data networks and need not be limited to a strictlypublic or private network.

The external device 2404 may be any computer or other remote resourcesthat connects to the computing device 2410 through the network 2402.This may include gateways or other network devices, remote servers orthe like containing content requested by the computing device 2410, anetwork storage device or resource, or any other resource or device thatmay connect to the computing device 2410 through the network 2402.

In general, the computing device 2410 may include a processor 2412, amemory 2414, a network interface 2416, a data store 2418, and one ormore input/output interfaces 2420. The computing device 2410 may furtherinclude or be in communication with peripherals 2422 and other externalinput/output devices that may connect to the input/output interfaces2420.

The processor 2412 may be any processor or other processing circuitrycapable of processing instructions for execution within the computingdevice 2410 or computer system 2400. The processor 2412 may include asingle-threaded processor, a multi-threaded processor, a multi-coreprocessor and so forth. The processor 2412 may be capable of processinginstructions stored in the memory 2414 or the data store 2418.

The memory 2414 may store information within the computing device 2410.The memory 2414 may include any volatile or non-volatile memory or othercomputer-readable mediums, including without limitation a Random-AccessMemory (RAM), a flash memory, a Read Only Memory (ROM), a ProgrammableRead-only Memory (PROM), an Erasable PROM (EPROM), registers, and soforth. The memory 2414 may store program instructions, program data,executables, and other software and data useful for controllingoperation of the computing device 2410 and configuring the computingdevice 2410 to perform functions for a user. The memory 2414 may includea number of different stages and types of memory for different aspectsof the operation of the computing device 2410. For example, a processormay include on-board memory and/or cache for faster access to certaindata or instructions, and a separate, main memory or the like may beincluded to expand memory capacity as desired. All such memory types maybe a part of the memory 2414 as contemplated herein.

The memory 2414 may, in general, include a non-volatile computerreadable medium containing computer code that, when executed by thecomputing device 2410 creates an execution environment for a computerprogram in question, e.g., code that constitutes processor firmware, aprotocol stack, a database management system, an operating system, or acombination of the foregoing, and/or code that performs some or all ofthe steps set forth in the various flow charts and other algorithmicdescriptions set forth herein. While a single memory 2414 is depicted,it will be understood that any number of memories may be usefullyincorporated into the computing device 2410. For example, a first memorymay provide non-volatile storage such as a disk drive for permanent orlong-term storage of files and code even when the computing device 2410is powered down. A second memory such as a random-access memory mayprovide volatile (but higher speed) memory for storing instructions anddata for executing processes. A third memory may be used to improveperformance by providing higher speed memory physically adjacent to theprocessor 2412 for registers, caching, and so forth.

The network interface 2416 may include any hardware and/or software forconnecting the computing device 2410 in a communicating relationshipwith other resources through the network 2402. This may include remoteresources accessible through the Internet, as well as local resourcesavailable using short range communications protocols using, e.g.,physical connections (e.g., Ethernet), radio frequency communications(e.g., WiFi), optical communications, (e.g., fiber optics, infrared, orthe like), ultrasonic communications, or any combination of these orother media that may be used to carry data between the computing device2410 and other devices. The network interface 2416 may, for example,include a router, a modem, a network card, an infrared transceiver, aradio frequency (RF) transceiver, a near field communications interface,a radio-frequency identification (RFID) tag reader, or any other datareading or writing resource or the like.

More generally, the network interface 2416 may include any combinationof hardware and software suitable for coupling the components of thecomputing device 2410 to other computing or communications resources. Byway of example and not limitation, this may include electronics for awired or wireless Ethernet connection operating according to the IEEE802.11 standard (or any variation thereof), or any other short or longrange wireless networking components or the like. This may includehardware for short range data communications such as Bluetooth or aninfrared transceiver, which may be used to couple to other localdevices, or to connect to a local area network or the like that is inturn coupled to a data network 2402 such as the Internet. This may alsoor instead include hardware/software for a WiMAX connection or acellular network connection (using, e.g., CDMA, GSM, LTE, or any othersuitable protocol or combination of protocols). The network interface2416 may be included as part of the input/output devices 2420 orvice-versa.

The data store 2418 may be an internal memory store providing acomputer-readable medium such as a disk drive, an optical drive, amagnetic drive, a flash drive, or other devices capable of providingmass storage for the computing device 2410. The data store 2418 maystore computer readable instructions, data structures, program modules,and other data for the computing device 2410 or computer system 2400 ina non-volatile form for subsequent retrieval and use. For example, thedata store 2418 may store without limitation one or more of theoperating system, application programs, program data, databases, files,and other program modules or other software objects and the like.

The input/output interface 2420 may support input from an output toother devices that may couple to the computing device 2410. This may,for example, include serial ports (e.g., RS-232 ports), universal serialbus (USB) ports, optical ports, Ethernet ports, telephone ports, audiojacks, component audio/video inputs, HDMI ports, and so forth, any ofwhich may be used to form wired connections to other local devices. Thismay also or instead include an infrared interface, RF interface,magnetic card reader, or other input/output system for coupling in acommunicating relationship with other local devices. It will beunderstood that, while the network interface 2416 for networkcommunications is described separately from the input/output interface2420 for local device communications, these two interfaces may be thesame, or may share functionality, such as where a USB port is used toattach to a WiFi accessory, or where an Ethernet connection is used tocouple to a local network attached storage.

A peripheral 2422 may include any device used to provide information toor receive information from the computing device 2400. This may includehuman input/output (I/O) devices such as a keyboard, a mouse, a mousepad, a track ball, a joystick, a microphone, a foot pedal, a camera, atouch screen, a scanner, or other device that may be employed by theuser 2430 to provide input to the computing device 2410. This may alsoor instead include a display, a speaker, a printer, a projector, aheadset or any other audiovisual device for presenting information to auser. The peripheral 2422 may also or instead include a digital signalprocessing device, an actuator, or other devices to support control orcommunication to other devices or components. Other I/O devices suitablefor use as a peripheral 2422 include haptic devices, three-dimensionalrendering systems, augmented-reality displays, magnetic card readers,and so forth. In one aspect, the peripheral 2422 may serve as thenetwork interface 2416, such as with a USB device configured to providecommunications via short range (e.g., Bluetooth, WiFi, Infrared, RF, orthe like) or long range (e.g., cellular data or WiMAX) communicationsprotocols. In another aspect, the peripheral 2422 may provide a deviceto augment the operation of the computing device 2410, such as a globalpositioning system (GPS) device, a security dongle, or the like. Inanother aspect, the peripheral may be a storage device such as a flashcard, USB drive, or other solid-state devices, or an optical drive, amagnetic drive, a disk drive, or other device or combination of devicessuitable for bulk storage. More generally, any device or combination ofdevices suitable for use with the computing device 2400 may be used as aperipheral 2422 as contemplated herein.

Other hardware 2426 may be incorporated into the computing device 2400such as a co-processor, a digital signal processing system, a mathco-processor, a graphics engine, a video driver, and so forth. The otherhardware 2426 may also or instead include expanded input/output ports,extra memory, additional drives (e.g., a DVD drive or other accessory),and so forth.

A bus 2432 or combination of busses may serve as an electromechanicalplatform for interconnecting components of the computing device 2400such as the processor 2412, memory 2414, network interface 2416, otherhardware 2426, data store 2418, and input/output interface. As shown inthe figure, each of the components of the computing device 2410 may beinterconnected using a system bus 2432 or other communication mechanismsfor communicating information.

Methods and systems described herein may be realized using the processor2412 of the computer system 2400 to execute one or more sequences ofinstructions contained in the memory 2414 to perform predeterminedtasks. In embodiments, the computing device 2400 may be deployed as anumber of parallel processors synchronized to execute code together forimproved performance, or the computing device 2400 may be realized in avirtualized environment where software on a hypervisor or othervirtualization management facility emulates components of the computingdevice 2400 as appropriate to reproduce some or all of the functions ofa hardware instantiation of the computing device 2400.

In one aspect, the computing device 2400 may be a mobile device such asthat described below.

FIG. 25 illustrates a mobile device. The mobile device 2500 may beconfigured for creating, sending, or receiving an SCCMC as describedherein. The mobile device 2500 may be, for example, any of the endpointsor other computing devices described above. The mobile device 2500 maybe, for example, a smartphone or a tablet. In general, the mobile device2500 may include a display 2502 (e.g., a screen), a communicationsinterface 2504 configured to couple the mobile device 2500 in acommunicating relationship with a network, a processor 2506, a memory2508, a camera 2510, a microphone 2512, a speaker 2514, and a locationtracking device 2516.

The communications interface 2504 may include hardware and software forcommunications using a variety of protocols such as a short-rangecommunications protocol (e.g., Bluetooth), a wireless communicationsprotocol (e.g., Wi-Fi, cellular network, and so on), and so forth. Thecommunications interface 2504 may couple the mobile device 2500 to acellular network or the like through a mobile carrier with which a userhas a billing account. The communications interface 2504 may also orinstead couple the mobile device 2500 to a data network through whichthe mobile device 2500 may access an online application store or thelike. The communications interface 2504 may also or instead couple themobile device 2500 to other mobile devices through a data network suchas any of the networks described herein.

In an aspect, the memory 2508 bears computer code that, when executingon the processor 2506, performs steps for creating, sending, receiving,editing, and so on, an SCCMC data structure or the like. The memory 2508may also or instead bear computer code that forms an application for themobile device 2500, e.g., execution by the processor 2506 on the mobiledevice 2500.

The display 2502 may include a screen such as a touch screen or otheruser interface for receiving user input as contemplated herein, e.g.,for the creation or editing of SCCMC. The display 2502 may also orinstead display SCCMC for a user.

The camera 2510 may be used for capturing images or video for use in anSCCMC.

The microphone 2512 may be used for receiving a voice or audio signal asdescribed herein.

The speaker 2514 may be used for playing audio from an SCCMC for a user.The speaker 2514 may instead include an audio output on the mobiledevice 2500 such as a headphone jack or the like.

The location tracking device 2516 may be used to establish a locationfor the mobile device 2500, e.g., for proximity services as contemplatedherein. The location tracking device 2516 may include a GPS receiver orthe like.

In certain embodiments, the mobile device 2500 may be used to facilitatea user (such as a recipient) to establish a personal channel such asthat shown in FIG. 26. The personal channel may enable the user tochoose media content, such as video and image content, from the user'smobile device 2500 and designate it to be used for display on the user'smobile device 2500 when an incoming trigger occurs. The incoming triggermay be an incoming call, a text message, or the like from another mobiledevice. The user may import multiple files and organize them to play asa personal channel, either in a pre-defined order or in a randomizedorder.

FIG. 26 illustrates a screenshot of a user interface 2600 for enablingthe user to establish such a personal channel. The user interface 2600may be configured to allow the user to swipe or otherwise select thefeature of establishing the personal channel by accessing the SCCMC Appinstalled on the mobile device 2500. For example, the SCCMC App mayenable selecting a menu feature labeled “My Channel” 2602 from the userinterface 2600. On selecting the menu feature “My Channel” 2602, theuser may be able to choose the media content that the user may want touse as part of the personal channel. In some embodiments, the mediacontent may include the SCCMC that may be received from any other user,or content made or captured by the user (such as using a camera of theuser's mobile phone), or a video obtained from a social networkingserver, such as services hosting services similar to YouTube™, Snapchat™Instagram™ or a user-generated video platform, or from any otherchannels, without limitations. The media content selected by the usermay be added to the user's personal channel by using a user interfaceelement such as an action button labeled “PERSONAL” 2604 as depicted inthe user interface 2600 of FIG. 26.

In certain embodiments, the personal channel created by the user may notonly be played on the user's device but may also be configured to beshared with other users. In many examples, a user may curate videos orother media content into a channel, then share that channel with otherusers, including controlling playing of that channel as a series ofSCCMC media items on phones of various recipients of the shared channel.These channels may also be customized or configured for particular usersor groups of users by allowing the user to create a channel suitable fora particular friend or group of friends and containing user-generatedvideo content showing mutual friends or topics of mutual interest orshowing video content that the user believes will be of particularinterest for the friend.

In embodiments, a channel shared with a friend or other user may includea wide range of media content, including an SCCMC received from otherusers, content made or captured by the user (such as using a camera ofthe user's mobile phone), content stored locally by other applications(such as social media applications), videos obtained from various socialsources such as YouTube™ or other user-generated video platforms, orfrom any other channel. The ability to configure, customize, and shareone or more channels may allow the SCCMC App to be used as aself-generated media creation and content distribution platform, wherethe user forms and orchestrates a wide range of experiences for friendsand other users that play on the lock-screens or other contact-initiatedelements of the friends' and other users' devices.

In many examples, the media content of the user's personal channel maybe enabled based on the identity of another user. For example, the usermay associate a video or any other media item with the name of a“friend” or a specific contact in the user's mobile device.

FIGS. 27 and 28 illustrate examples of screenshots of a user interface2700 for enabling a media content based on the identity of a user. Theuser interface 2700 may be enabled by the SCCMC App installed on theuser's mobile device. The user may open a contact list on the user'smobile phone, and a menu 2702 displayed on the user interface 2700 mayprovide options such as “Ask Friend”, “Upload”, “customize for contact”,and other options that may enable setting a media content from theuser's personal channel for a particular contact, based on the identityof the contact. For example, the user may set a custom video or channelfor an individual contact or friend by making appropriate selectionsfrom the user interface 2700.

In various embodiments, various kinds of media content, including SCCMCreceived from other users made or captured by the user such as by usinga camera of the user's mobile phone, videos obtained from varioussources, YouTube™ or other user-generated video platforms, or from anyother channel, may be set in the name of the friend. In someembodiments, the SCCMC App may enable the user to integrate the mobiledevice with user-generated social media applications or platforms usedby the user's mobile device, such as in cases where the user has othersocial networking applications such as Snapchat™, Instagram™, or thelike installed on the user's device. These social networkingapplications may enable the user to save content to a local device sothat when the content is created, it may be saved in a local folderassociated with each application. The SCCMC App may include a localstorage monitoring component that may monitor the local folder and makethe content of the local folder available for selection as an SCCMCmedia item that may be played in a user channel, set as contentassociated with a friend, or the like. This may be accomplished byimporting the content into one or more locations accessed by the SCCMCApp, or by tagging the local folder so that the content may be importedor played when needed from the local folder.

Once this setting is initiated, the selected or tagged content may beconfigured to play on the lock-screen of the user's phone when thefriend calls or upon other triggers, such as upon receiving a text oremail from the friend, independent of what channel the user may haveselected for incoming calls or other triggers that arrive from otherparties.

In embodiments, the user may select an option to “Ask Friend” 2704 (ormultiple friends), where the SCCMC App may enable a feature allowing auser to choose to have a friend set a media item, such as a video thatplays when the friend calls, such that the friend controls the mediacontent item. In many examples, the feature may be enabled such as whensetting custom content by the friend, as discussed in some of theprevious examples, that allow the user to set the video that plays whenthe friend contacts the user. Upon initiating this “Ask Friend” 2704feature, a message, such as a text message, may be initiated through theApp to the friend, automatically embedding a custom link to a websitewhere the friend may upload a media item, such as a video and the like.

In embodiments, the user may also be allowed to choose more than one ofthe contacts for selecting the “Ask Friend” 2704 feature from the userinterface 2700. The user interface 2700 may present a list of contactsor “friends” to the user and the user may select top friends by choosingan action button, such as the button 2704, for implementing the “AskFriend” 2704 option. In many examples, the top friends may includecontacts that are most frequently contacted by the user, such as bycalling or messaging. In other examples, other parameters may be used toclassify a list of contacts as the top friends of the user. When theuser clicks on the button 2704, the SCCMC App may enable initiatingsending a message, such as a text message, through the App to each ofthe top friends. Initiating the message may include automaticallyembedding a custom link to a website where each of the top friends mayupload a media item, such as a video.

FIG. 29 illustrates a screenshot of an exemplary user interface 2900that may enable the user, such as a friend contact of the sender, tocreate a video that may be played when the friend contact calls orinitiates any contact with the user. The video created by the friend maybe uploaded by the friend on the website and a link thereto may be sentto the friend, such as when the user selects a contact for the friendfrom the “Ask Friend” 2704 feature of the SCCMC App. The video may beone of a type of media item that may be used to set specific media typesfor specific contacts.

In embodiments, the media item may include the SCCMC received from otherusers, content made or captured by the friend or the user, such as usinga camera of the friend's or user's mobile phone, videos obtained fromvarious network sources such as YouTube™ or other user-generated videoplatforms, or from any other channels. In embodiments, the uploadwebpage by which the friend may set an item to play on the user's devicemay be configured to work with mobile and desktop browsers. When thefriend uploads a media item, a push notification may be automaticallydirected to the user's device, indicating that the content has beenuploaded. When the friend calls the user or optionally upon othertriggering contacts, such as text, chat, or email contacts, thefriend-uploaded media content item may play on the user's phone, such ason the lock-screen of the phone.

In embodiments, the user may use the “Ask Friend” 2704 feature to askvarious friends to upload or select media content, such that a varietyof different media content may be played based on different contacts,augmenting items that the user has set or selected for friends, or itemsthe user has generally selected for unknown inbound contacts.

The various embodiments as discussed herein may facilitate creating,editing, deployment, and managing of media content available in themobile phone or received from other devices or network sources and to beused as the SCCMC for establishing personalized experiences or forsharing among a group of friends and contacts for personalizedexperiences during any trigger events such text messaging, ring tones,and the like with the use of various menu options as enabled through theuser interfaces such as those illustrated in conjunction with FIGS.26-29.

In many examples, the SCCMC App may enable setting up media contentincluding SCCMC. The media content may include video content that mayinclude a contextual video message. FIG. 30 illustrates a flowchart of amethod 3000 for providing a setup of a contextual video message includedin SCCMC for an interaction between users.

As illustrated in FIG. 30, a User 1, such as the user of a sender mobilephone 102, may access a messaging facility at 3002. The user of thesender mobile phone 102 (FIG. 1) may be involved in a messaginginteraction with another user, a User 2, such as the user of a recipientmobile phone 104 (FIG. 1). The messaging interaction may use any of theavailable messaging facilities such as an SMS, a chat interaction, orany of a number of messaging applications such as WhatsApp?™, iMessage™,Snapchat™, Instagram™, Messenger, and the like available on both theusers' respective mobile devices. In embodiments, the app may host theentire communication exchange without relying on a third partyapplication. At 3004, the User 1 may enter some text on an inputinterface of the messaging facility of the User 1's mobile device andsend the text or other messages to the User 2. The input interface ofthe messaging facility may be configured to receive at least text input.In one example, the input from User 1 is limited to what may be keyed inor dictated text. The input interface of the messaging facility may alsobe configured to receive text, graphics, audio, video, and combinationsthereof including emojis and other graphics that may be inserted withthe input interface. The SCCMC App installed on the mobile device ofUser 1 may have access to the input entered on the input interface ofthe messaging facility. Similarly, the SCCMC App installed on the mobiledevice of User 2 may be configured to access the input received on theinput interface of the messaging facility on the User 2's mobile device.

At 3008, the input sent by the User 1 may be received at the messagingfacility of the User 2's mobile device. At 3010, the SCCMC App installedon the User 2's mobile device may be configured to take the inputreceived on the input interface of the messaging facility of the User2's mobile device and process the content of the input to determine themeaning of the text and to understand the context of the input. Inembodiments, the SCCMC App installed on the User 2's mobile device mayalso be configured to take the input received on the input interface ofthe messaging facility of the User 2's mobile device and process thecontent of the input to determine the meaning of the audio, video,graphics, emojis, and the like to understand the context of the input.The processing of the input may be enabled by the use of a high-levelprocessing facility including a natural language processing (NLP)facility that may include one or more algorithms or methodologies fordetermining the meaning of a body of text, such as the text received atthe input interface of the messaging facility of the mobile device ofUser 2. It will be appreciated in light of the disclosure that in someexamples one or more algorithms of the natural language processing (NLP)facility may be shown to perform more quickly when the input is limitedto text and other limited characters.

In embodiments, the natural language processing (NLP) facility may alsoinclude additional algorithms or methodologies for determining themeaning of a conversation in an audio or video clip. In many examples,the NLP facility may include an NLP processing module that may beconfigured to execute a series of instructions, such as in accordancewith the one or more algorithms and methodology to identify the meaningand/or context of the input. By way of these examples, the NLP facilitymay be configured to extract the words, phrases, emojis, geo-locationinformation and sensor-derived data from the text received at themessaging facility of the mobile device of User 2. In embodiments, theextracted information from the text may then be matched to a database ofcontent, such as a database stored in the memory unit 2414 of thecomputer system 2400 discussed earlier. In many examples, the NLPprocessing module may be a part of the processor 2412 of the computersystem 2400 discussed earlier. In further examples, the NLP processingmodule may be a part of the other hardware 2426 of the computer system2400.

At 3012, the meaning identified by the NLP processing module may be usedby the SCCMC App installed on the mobile device of User 2 to assignmedia content to the input received at the input of the messagingfacility of the User 2's mobile device. The media content data typesdiscussed earlier, such as a video clip or a video channel may beappropriately linked to the input message. In many examples, mediacontent may be selected from a curated library of the SCCMC-contenttypes such as that discussed earlier. At 3014, the assigned mediacontent may be displayed, in many embodiments, on the lock screen of themobile device of User 2. At 3018, the User 2 may then tap on his or herlock screen to send the reply to the User 1. In many examples, the User2 may send the reply directly from the lock screen of the User 2'smobile device without opening the input interface of the messagingfacility on his or her mobile device.

In many examples, the User 2's camera may be activated by default whilesending the reply to the User 1 and a picture or photo of the User 2 maybe associated with the reply sent from the User 2 to the User 1. Infurther examples, the User 2's microphone may be activated by defaultwhile sending the reply to the User 1 and an audio clip the User 2 maybe associated with the reply sent from the User 2 to the User 1.

In many examples, as the User 2 types a text for the reply message, somecontent may be automatically pulled from the database of content tomatch the keywords of text entered by the User 2. In embodiments, theUser 2 may use the content automatically pulled from the contentdatabase or may alternately access the messaging facility to completethe text and then send the message. The message sent from the User 2 mayalso be processed in the same manner when received at the messagingfacility of the User 1 during the messaging interaction.

FIGS. 31A-31E illustrate an example of a messaging interaction betweenthe User 1 and the User 2 based on the contextual video message flowdiscussed in FIG. 30 in accordance with the many embodiments. FIG. 31Aillustrates a screenshot of a display interface 3100A of the User 2'smobile device when the User 2 receives a message with a text phrase,“Hungry? Meet for lunch?” from the User 1. The text phrase may bedisplayed on the User 2's mobile device along with an associated andmatching video or other content. The matching of the video or othercontent with the text phrase may be performed based on the content ofthe text phrase, as discussed in the flow of FIG. 30. For example, thevideo in FIG. 31A displays a hungry Homer Simpson cartoon character witha bulging and shaking stomach to indicate the emotion of hunger. In anexample, the video may be derived from the curated library ofSCCMC-content types of the SCCMC App. Similarly, FIG. 31B illustrates ascreenshot of the display screen 3100B of the User 2's mobile devicewhen a text message phrase, “So hungryyy!!!”, is received at the User2's mobile device from the User 1. In embodiments, the text messagephrase may be displayed along with a matching video/photo of the sender,such as a photo of the User 1 taken from the camera of their mobiledevice at the time of sending the message and emoting a feeling ofhunger. In further examples, a screenshot of the display screen themobile device of User 2 may receive an audio message that says, “I'mhungry!” from the User 1 including with a matching video/photo. Inembodiments, a matching video/photo of the sender, such as a photo ofthe User 1 taken from the camera of their mobile device, may be sent atthe time of sending the message.

FIG. 31C illustrates a screenshot of the display screen 3100C of theUser 1 when a reply message is sent from the User 2 to the User 1, suchas on the lock screen of the user 1, and where the reply messagecontains the text phrase “Bennys@8 pm??.” The text phrase is associatedwith a matching content such as interactive information about therestaurant name mentioned in the text, namely “Bennys.” In embodiments,such information may be available even though the lock screen is inplace on the mobile device. In embodiments, the interactive informationmay include, for example, a map of the restaurant location, the ratingsfor the restaurant, the restaurant's brochure, directions, tips,reviews, and other contextual advertising information associated withthe restaurant name. In an example, the reply message may also orinstead include information about the type of food and the matchedcontent may be displayed accordingly. In many examples, a message thatcontains the phrase “want to get tacos?” may be augmented by a video oranimation showing tacos. The meaning assigned to the phrase mentioned inthe message may be based on a context as well as the content of othermessages. By way of the above example, the initial reference to gettingtacos may be used to help infer that a follow-on message proposing aname and time is a reference to a restaurant location where tacos areavailable. Further, the context of the message may be identified such asby using the user's history of interactions with other users, thehistory of use of the SCCMC App by the user or other users, thegeo-location of the user, user contact data (such as stored contacts),the profile of User 1 or User 2 (or both), and many others andcombinations thereof. Thus, the matching content for the text in themessage may be SCCMC media content that may be automatically associatedwith an item of media content may be relevant to both the content of themessage and the context of the message.

In many examples, the association of media content with text entered inthe input message may be performed by applying one or more machinelearning algorithms. In many examples, the machine learning algorithmand other methodologies may be used to interpret the body of text in theinput message and identify what type of media may be associated withwhat type of text input. In an example, the interpretation may be basedon feedback information entered into the machine learning algorithm suchas a feedback information gathered directly from the users regarding theextent of satisfaction with the content recommended by the SCCMC App.Apart from the feedback information gathered directly from the users,the feedback information may also or instead be derived based on somefeedback metrics associated with the SCCMC App. In many examples, thefeedback information may be derived based on a metric associated withthe use of the recommended content such as whether the user saves thecontent, shares the content, interacts with the content, and the like.The feedback information may be used to provide more relevant andrelatively effective media content in response to the text received inthe input message.

For example, FIG. 31D illustrates that a text entered by a user on theirlock screen 3100D may be automatically completed and matched with therelevant media content. The completed content is illustrated in thescreenshot of the display 3100E of FIG. 31E. In embodiments, the matchedand completed content on the display 3100E may be used directly from thelock screen by the user or alternatively, the user may override thecontent. In both the scenarios, the user feedback may be used to derivethe feedback information for the machine learning algorithm.

In embodiments, methods and systems described herein includingSCCMC-based structures such as the SCCMC app and the SCCMC mediacontent, may facilitate user access to or may serve as any of a varietyof mobile communication capabilities or applications on a user's mobiledevice, e.g., text messaging, video calling, audio calling, and the likeincluding use of various networking and transport protocols such asIP-based protocols, cellular networking protocols, or others. Inembodiments, the communication capabilities or applications may beaccessed directly from a user's lock screen, without requiring the userto unlock the phone or open the communication application. As such, theuser need not unlock the mobile device to access the SCCMC app and itsmedia content. In embodiments, the methods and systems may interfacewith one or more communication port features of a mobile device (such asones for handling incoming IP-based messaging, ones for handlingnotifications, ones for handling incoming cellular messages, and thelike) to effectively redirect information communicated to the mobiledevice that is destined for the other communication capability orapplication to a lock-screen capable application. In embodiments, thelock-screen capable application may operate independently of the lockedor unlocked state of a phone or other mobile devices, such as when adevice is locked, the screen is blank, it displays its lock screen, orthe like. The lock-screen capable application may intercept informationdestined for or originating from a communication application (e.g.,Snapchat™, Facebook Messenger™, iMessage™, WhatsApp™ and the like) ormay serve in replacement of such applications as it is received by arecipient mobile device. In embodiments, the recipient mobile device mayinclude SCCMC data structures that may perform contact media adaptingfunctions prior to being sent from a sender mobile device includingproviding a user interface that operates while a phone is in lock screenmode. The user interface may include the lock screen capable applicationin order to facilitate a user of the mobile device receiving andresponding to a communication associated with the interceptedinformation before delivery to the communication application, acommunication associated with the intercepted information processed bythe user interface directly, or the like. In embodiments, thelock-screen capable application may display a wide range of content inresponse to the intercepted information, such as video content,animations, or a wide range of other types of content describedthroughout this disclosure. In embodiments, the content may consist of avideo. In embodiments, the video may be selected by the sender of theinformation. In embodiments, the video may be selected from a channel,where the video and/or the channel may be selected based on the contentof the intercepted information and/or the context of the informationsuch as based on the time of day, the location of the sender, thelocation of the recipient, the state of the recipient's device, or otherfactors. In embodiments, the lock-screen capable application may alsointerface with the target/source communication capability or applicationto facilitate end-to-end communication between the relevantcommunication capability or application on the sender mobile device andthe recipient mobile device without the necessity for a third partycommunications applications.

FIG. 32 depicts a diagram of a unified messaging platform 3200 asdescribed herein. In embodiments, a sender 3202, such as a mobile phoneor the like may communicate over an electronic medium, such as anIP-based network, cellular network and the like with a recipient 3204,such as a recipient mobile phone or the like using the methods describedherein. In embodiments, communication among one or more senders 3202 andone or more recipients 3204 may include a platform server 3206.Communication among one or more senders 3202 and one or more recipients3204 may include the use of messaging services, such as native messagingservices 3210, 3212, messaging applications 3214, 3218,sender-controlled contact media content applications 3220, 3222,directly, and the like. Communication among one or more senders 3202 andone or more recipients 3204 may also include use of content associationservices 3224, 3228, A sender may use sender mobile phone 3202 orsimilar computing device configured with one or more capabilities and/orapplications, such as native messaging services 3210 that may facilitatecommunicating with other users, such as recipients, servers and thelike. In embodiments, the sender mobile phone 3202 may further beconfigured with messaging applications 3214, such as those mentioned anddescribed herein for facilitating communication of text, images, video,and other electronic content among senders and recipients. Inembodiments, the sender mobile phone 3202 may also be configured withone or more unified messaging applications or capabilities, such as asender-controlled contact media content application 3220 that may workcooperatively with (or in lieu of, partially or wholly) the nativemessaging services and/or messaging applications of the mobile device tofacilitate the sender-controlled contact media content control functionsand capabilities described herein.

In embodiments, these SCCMC features include performing natural languageprocessing (NLP) 3230, 3232 on a message prepared in any of themessaging applications including the SCCMC application 3220, 3222, andon content associated with an outgoing message as described herein. Inembodiments, other features of a sender 3202 may include one or sendermood sensing 3240, sender user state determination 3242, and the likethat may provide information to the SCCMC application 3220, and fromother SCCMC applications. In embodiments, the features, capabilities andthe like of a sender 3202 may be embodied as individual applications,local services available to an SCCMC application 3220, remote servicesaccessed through mood sensing and/or user state determination interfacecapabilities of the sender mobile device and the like. In embodiments,the mood sensing 3240 may also include mood determination capabilitiesby interfacing with mood determination services 3250 of the unifiedmessaging platform 3200, or may perform mood determination functionsdirectly or partially using the processing and storage capabilities of asender 3202 mobile phone and the like.

In embodiments, the platform server 3206 of unified messaging platform3200 depicted in FIG. 32 may interface through a network connection orthe like with at least the sender 3202 or the recipient 3204. Theunified messaging platform 3200 server 3206 may further provideservices, applications, and/or capabilities for unified messaging asdescribed herein including the mood determination 3250 for determining amood of a user of the unified messaging platform 3200 including thesender 3202 or the recipient 3204. In embodiments, the platform server3206 may also provide natural language processing 3252 services forprocessing messages composed on a sender device 3202 that may bedestined for or received on a recipient device 3204. In the manyexamples, the NLP services 3230, 3232 may be provided to any of theparticipants in the platform via the natural language processingcapability 3252 executing on the platform server 3206. The platformserver 3206 or other aspects of the platform 3200 may also providecapabilities such as machine learning via a machine learning capability3260. The platform server may further provide content associationservices 3262 via a content association capability executing at leastpartially using the computing and/or storage features of or accessibleto the platform server 3206.

In embodiments, the unified messaging platform 3200 may further includea media content library 3270 that may include or be associated withsender-controlled contact media content structures 3272. Participants onthe platform 3200 one more senders 3202 may be provided access to thecontent library 3270 over one or more networks and when applicable, viathe platform server 3206. Similarly, one or more recipients 3204 of theplatform 3200 may access the media content library 3200 via a network,through the server 3206, and the like. Features, functions, and servicesof a media content library including association and/or integration ofone or more SCCMC structures when applicable are further describedherein.

In embodiments, a unified messaging platform, such as platform 3200depicted in FIG. 32 includes recipient 3204 that may be embodied as amobile device or the like. In the many examples, the recipient 3204 ofthe platform 3200 may include unified messaging capabilities that aresimilar to the sender 3202 capabilities, such as content associationservices via a content association module 3228, native messagingservices via a native messaging module 3212, messaging services viamessaging applications or services 3218, NLP services through a naturallanguage processing module 3232, and the like. In embodiments, therecipient 3204 may include or have access to other capabilities, such asa recipient SCCMC application 3280 that may include functionalitysimilar to a sender SCCMC application 3220 but also may be adapted towork cooperatively with native screen like services 3282, a lock-screencapable application 3284 and the like that may be embodied with and/oruse processing and/or storage resources of the recipient 3204 computingdevice. Capabilities of the recipient SCCMC application 3280, includingits cooperative operation with the lock-screen capable application 3284and or its optional integration with the lock-screen capable application3282 are described further herein.

In embodiments, the media content library 3270 may provide storage formedia content and optionally for SCCMC items or may be associated withSCCMC structures as described herein. FIG. 33 depicts embodiments of themedia content library 3300 that facilitate associating content itemswith a media type, SCCMC references (if any), one or more channels(e.g., topics of interest) and the like. The embodiments of FIG. 33 mayalso include an index for accessing items in a media content library3270, SCCMC structures 3272, and the like.

FIG. 34 depicts embodiments of media content library 3402 that mayincorporate media content items 3404 and SCCMC content items and/orstructures 3406. As described herein for many of the embodiments, mediaitems and/or SCCMC content items or structures 3406 may be arranged intochannels, which may be based on topics of interest. In embodiments, anexemplary channel indicator 3408 for a set of SCCMC structures for asender 1 (SCCMC 1-x) may provide a mechanism by which a sender's SCCMCstructures may be accessed as a channel as described herein. In theembodiments of FIG. 34, a composite media content library 3402 may alsoprovide access to media content items as a media channel 3410.

In embodiments, FIG. 35 depicts an alternate configuration of a mediacontent library 3502 that may operate cooperatively with an SCCMCstructure library 3508 to provide the services and capabilities of aunified messaging platform and the like as described herein. In theembodiments of FIG. 35, the media content library 3502 and the SCCMClibrary 3508 may be accessed by various functional modules of theplatform, such as the sender SCCMC application 3220, the contentassociation capability 3220 and the recipient SCCMC application 3222. Inembodiments, each application or capability may determine theappropriate library to access based on the type of media being selectedand/or the function being performed. Channels, as used herein, may beconfigured for the SCCMC library 3508 and the media content library 3502such that the items in each library may be accessed via channelreference without requiring that each particular item is referenceddirectly.

The embodiments of FIG. 36 depict sender device elements 3600 of aunified messaging platform and flow of information among sender elements3600. Description of the sender elements may be made with reference toFIG. 32 with the exception of a communication interface 3606 and aunified messaging user interface 3604. In embodiments, the flow ofinformation among the elements may include one or more messagingapplications 3214 or services 3210 interfacing with a sender SCCMCapplication 3220. The messaging applications may send information to theSCCMC application 3220, such as text or other electronic content thatmay be composed or selected the sender using, for example, functions ofthe messaging applications with or without using a user interface of themessaging applications. The sender through the unified messaging userinterface 3604 via the SCCMC application 3220 may access the functionsof the messaging applications. In embodiments, the SCCMC application3220 may access user state determination facility 3218 to determine astate of the user of the mobile phone and mood sensing facilitate 3212to determine a mood of the user. This user state and/or mood informationmay be used by the SCCMC application 3220 along with natural languageprocessing capabilities 3214 to operate a content association function3224 to associate an item of content from the media content library 3270and/or the SCCMC structure library 3272 with content of a message fromthe messaging services or applications. In embodiments, the SCCMCapplication 3220 may reconfigure the message with the item of contentand provide that to a communication interface 3606 of the sender device3602 where it may be communicated to a recipient computing device overan IP network or the like. In the many examples, the unified messaginguser interface 3604 may include features that facilitate the senderselecting among a plurality of content items that may be selectedthrough the content association operations described herein.

FIG. 37 depicts embodiments that are representative of a gallery ofcontent items 3700 that may be suitable for use with the one or moremessages being sent and received. In embodiments, a user (e.g., thesender) may operate the unified messaging user interface 3604 to selectone more content item manually. In further embodiments, a content itemmay be automatically selected and the message may be configured with theselected content item for delivery to a recipient. Whether manually,automatically, or combinations thereof, the content items 3700 arecandidate media content that may be accessed manually and/orautomatically.

FIG. 38 depicts exemplary operations of the methods and systems 3800 forcontent modification of an incoming message via an interception by alock-screen capable application and processing thereof using the methodsand systems described herein to append, adapt, and/or replace a contentitem associated with the intercepted message. In embodiments, a messagethat may be received by the recipient 3802 may be intercepted by alock-screen capable application 3284 that may include or accessfunctions such as natural language processing 3232 and the contentassociation services 3228. In embodiments, the message that may bereceived by the recipient 3802 and intercepted by the lock-screencapable application 3284 may also interface with a recipient SCCMCapplication 3280 to determine a content item that may be automaticallyor manually selected from the media library 3270, the SCCMC structureslibrary 3272, or the like. In embodiments, the determined content itemmay be configured with the intercepted message and processed through therecipient SCCMC application 3280 (partially or wholly) or forwarded onto a corresponding messaging service or application. In embodiments, themodified message may be presented in a unified messaging user interface3604 that may be made accessible by the lock-screen capable application3284 without requiring that the lock state of the phone or connecteddevice to be changed. The recipient 3802 may use the unified messaginguser interface 3604 while the phone or connected device remains in anotherwise locked state to respond to the modified message. FIG. 39depicts exemplary embodiments of the unified messaging user interface3604 including a responsive modified message 3900 from the recipient3802 to the sender 3602 and/or others in accordance with the manyembodiments of the present disclosure.

In embodiments, the methods and systems related to automatedgif/image/video identification based on content of a contact event, suchas a text message and the like, may be beneficially applied for a widerange of languages. In particular, languages that include a large numberof characters, such as some Eastern languages that may have one thousandor more characters, may benefit from the methods and systems describedherein by automating annotation of typed content with at least one ormore of the natural language processing approaches described herein. Inaddition to facilitating association of image-related content with suchmessages based on NLP of their text content, audio-based messages maybenefit from the NLP-based image selection by adding a speech-to-textfunction that prepares an item of text content for the NLP. An imagederived from the NLP processing of the generated text may be associatedwith the audio. In embodiments, an image may be tagged with the audiocontent so that transmitting the image to a recipient messagingapplication may result in the image being displayed while the audio isplayed back. In embodiments, more than one image may be associated withan audio message, such as based on NLP of a plurality of portions of theaudio message. The more than one image may be configured in a slide showor the like that is coordinated with the audio file based on the NLPoutput so that each of the more than one image may be played back in asequence that tracks with the relevant audio. In embodiments, the NLPmay determine that a first portion of an audio transcribed message mayembody a first theme or emotion and a second portion, that may followthe first portion may embody a second theme or emotion. A first imagemay be recommended and/or selected for the first portion and may beconfigured to display (e.g., by associating playback metadata with theimage and the like) for a duration of time that is consistent with thefirst portion of the audio transcribed message. Likewise, the secondimage may be recommended and/or selected for the second portion andconfigured to display for a duration that is consistent with the secondportion of the audio transcribed message. In embodiments,audio-associated image(s) may be recommended, selected, and exchanged asdescribed herein between at least two users in a form ofaudio-messaging, such as VoIP, audio file capture and playback, and thelike.

FIG. 40 depicts an embodiment of the platform of FIG. 32 with theaddition of speech to text functionality to enable the use of naturallanguage processing, such as for recommending candidate images to beassociated with an audio message. A sender 4002 may be configured with,among other things, natural language processing 3214 as describedherein. A user of a sender system 4002 may record an audio message. Theaudio message may be processed at the sender 4002 with a speech to textfacility 4008 that may generate a text transcription of the audiorecording. The NLP facility 3214 may process the transcription todetermine a theme, intent, emotion, and other understanding of the audiomessage. As described elsewhere herein a sender SCCMC application 3208may present the sender user with one or more recommended image contentsto be associated with the audio message based on the NLP determinedtheme, intent, emotion or other understanding. The SCCMC application maycommunicate the audio message, and/or one or more of the image contentsselected by the sender user, and/or the transcription to one or more ofa platform server 4006 and a recipient 4004. Processing of thetranscription may be performed by a natural language processing facility3214′ of the platform server 4006. Likewise, speech to text processingof the audio message may be performed by a speech to text facility 4008′of the platform server 4006. The platform server 4006 may perform speechto text and NLP and recommend one or more image contents to a senderuser and the like. The platform server 4006 may combine a sender userselected image content with the originating audio file so that the imagecontent is presented on an electronic interface of the recipient device4004 when the audio message is played, such as on a lock screen of therecipient device 4004.

Referring to FIG. 41 a flowchart of audio message processing using, forexample, the platform of FIG. 40 is depicted. A sender computer 4101 maygenerate an audio content item 4111 that may be provided to a platformwhere the audio content may be received 4102. Speech to text algorithms4104 may be applied to the audio to generate a text transcription of theaudio. The transcription may be processed by a natural languageprocessing facility 4106. The output of the natural language processingfacility 4106 may be processed by an image-content review andrecommendation facility 4108 that may use the NLP output to select amonga plurality of available content images 4115 to recommend at least onecontent image to a user, such as a user of the sender 4101. The user mayselect and/or approve of a recommended image in step 4110 image-contentselection/approval. A selected image may be linked with the receivedaudio file at step 4112, the audio content may be further linked to theselected image to facilitate coordinated playback on the recipientcomputer 4103.

In support of a user interface for facilitating selection of one or moreimages to be associated with a message, measures of user preference forthe one or more images may be used when recommending images. Measuringuser preference may be similar to those used in social mediaenvironments, such as providing a “thumbs up/down” function, providing a“like” function, detecting an amount of time a user dwells on an image,and the like may be used to help determine a likelihood that an image,such as a GIF, photograph, video and the like is popular. These measuresof image popularity may be combined with other measures associated withthe images, such as utilization of the image in messages, reuse of theimage, social media activity of a message with a given image (sharing,re-sharing, reposting, re-tweeting, and the like) to form an additionaldegree of a likelihood of image popularity. These measures may becombined with natural language processing of text of messages thatinclude the image to better determine if the resulting output of the NLPis consistent with social media perception of the combined text andimage. As an example, NLP of text may suggest a particular image. Socialmedia-based perception of the combination of text and the particularimage may support the suggestion (e.g., social media users may indicatea preference for the combination, such as by liking the message ortaking another action, such as reposting the message), or may indicatethe suggested image may not be a suitable image for the text (e.g.,social media users may indicate a dislike for the combined image/text,such as by disliking the message or exhibiting a lack of action such asnot reposting the message). Therefore, prioritization of images may berepresented as a function of user responses to the image in the userinterface, social media responses to the image and/or to messages thatinclude the image, such as Image-Prioritization=f(user interfaceresponse)+f(social media response). Additionally, in embodiments, imageprioritization may be used in the platform user interface to determinean order, arrangement, image quality, image size, and the like forpresenting candidate images in the user interface. Images with lowerprioritization scores may be presented as smaller images, may bepresented further down in a gallery of images, and the like.

Social media perception of images and/or messages that include an imagemay also be used as an input, such as a seed for natural languageprocessing of text content of an image. Social media perception that mayindicate that a message is popular, may facilitate determining temporalrelevance of the message, which may indicate an importance of an emotionor other understanding of the message that may be derived from naturallanguage processing of the message, and therefore temporal relevance ofsome of the words in the message. This temporal relevance, which may beshort term or long term relevance, may be linked with one or more wordsin the message so that those words appearing in other messages mayindicate a similar relevance or at least may indicate a relevance of anemotion and the like conveyed by the message. This information may beuseful in validating and guiding for improvement natural languageprocessing of the message.

Sources for images for the methods and systems for automated imagerecommendation and/or selection for inclusion with a message may includepublic images sources, such as publicly available social media photogalleries. In embodiments, social media and the like public galleries ofparticipants of a message, such as a sender and a recipient, may be asource of candidate images. Through the use of tools such as facerecognition, images may be organized based on detectable faces inphotos. Further through the use of NLP of a text portion of a messagebeing communicated from a sender to a recipient, a context of themessage may be determined. The context of the message may be coded sothat it can be used to facilitate selection of one or more candidateimages from the sender's social media accessible photos, the recipient'sphotos, or a combination thereof. In an example, NLP may be used toanalyze a message text content to generate a context or understanding ofthe message. In embodiments, such an understanding may suggest that asender is inviting a recipient to dinner. The understanding may be codedinto keywords, such as dinner, invitation, and the like that may beuseful for indexing into a gallery of photographs of the sender and/orrecipient. Images that are indicated by the keywords to be similar tothe NLP understanding of the message may be suggested for use with themessage.

In embodiments, the methods, systems and algorithms described herein forfacilitating recommendation and/or selection of image-like content foruse with a text and/or audio message, which may be based on naturallanguage processing of the text and/or a transcript of the audio, mayalso be applied to other types of content than image-like content. Inembodiments, messages with text may be tagged, such as with a hash tagand the like (e.g., a tweet, and the like). Hash tags may be appliedacross a plurality of messages, typically as an organizing tool tofacilitate associating different messages that may share a common theme.Natural language processing, which may generate information about amessage, such as its theme, may be applied to recommend one or more hashtags from a pool of hash tags based on the NLP-derived message theme,emotion, and the like. Hash tags may also be associated with descriptivemetadata, that may be produced through use of NLP applied to the hashtag. This descriptive metadata may be useful in matching and/orrecommending hash tags with content. In embodiments, NLP applied to amessage text content may produce an understanding (e.g., theme, emotion,and the like) that may be coded to facilitate matching candidate hashtags from a pool of hash tags based on, for example, the hash tag itselfand/or metadata associated with the hash tags. The candidate has tagsmay be presented in a user interface, comparable to the user interfacedescribed herein for manually selecting image content to be combinedwith a message text content. User interaction with the presented hashtags may be measured and used to further determine which hash tags arepreferable for different types of text message content. In embodiments,a portion of the pool of hash tags may be processed with naturallanguage processing to generate metadata descriptive of each hash tag,such as a theme, emotion, intent or understanding. This natural languageprocessing generated metadata may be used in the selection of candidatehash tags, such as by determining a similarity of this natural languageprocessing generated metadata with an output of the natural languageprocessing of the message. In embodiments, the content matching platformmay communicate the output of the natural language processing of themessage to the messaging platform via an application programminginterface.

In embodiments, an interface, such as an API, may facilitate interactionbetween a content matching platform that employs the methods and systemsdescribed herein and a messaging platform, such as a message platformthat uses hash tags. The API or similar computer interface mayfacilitate the content matching platform programmatically receivingmessage content that it may processes, such as with NLP to develop anunderstanding of the message. The content matching platform may use theNLP to select among a plurality of hash tags to provide, through the APIto the messaging platform for potential inclusion with the message. Inembodiments, the content matching platform may provide informationderived from the understanding to the messaging platform that mayperform some degree of hash tag matching. In embodiments, the API mayfacilitate a user of the messaging platform to view candidate hash tagsprovided by the content matching platform. The user may view thecandidate hash tags in an interface that is native to the messagingplatform or that is shared with the content matching platform, such asby providing a link to a web page that contains the interface.

In embodiments, an interface, such as an API, may facilitate theexchange of message-based content and image-based content (e.g., gifs,and the like) between a messaging platform (e.g., TWITTER™) and thecontent-matching platform. This interface may facilitate the messagingplatform providing message text content and the like to the contentmatching platform that may apply, among other things, natural languageprocessing to develop an understanding of an intent of a message, suchas a theme, emotion and the like. This understanding or result of otherprocessing performed on the message text content may be used to identifyone or more candidate image-type content items. The API may facilitatethe transfer of these one or more candidate image-type content itemsfrom the content matching platform to the messaging platform forinclusion with the text portion of the message. In embodiments, themessaging platform may receive any of the one or more candidate imageitems, a coding of the understanding, a link to one or more candidateimage items, a complete message including the text content provided fromthe messaging platform and the one or more candidate image items, andthe like.

Referring to FIG. 42, a flow chart for use of natural languageprocessing to facilitate recommendation and/or automatic selection ofhash tags for use in a hash tag based messaging platform via a messagingplatform interface, such as an API is depicted. Text of a message andthe like may flow from a messaging platform 4201 via an inter-platformcommunication API 4203 to a content matching platform message receptioninterface 4202. The message, such as a text portion of a message, may beprocessed by a natural language processing facility 4206 to determine,as described herein, an intent, emotion, theme, or other understandingof the message text. The output of the NLP facility 4206 may be used toreview and recommend at least one hash tag from available hash tags 4115for potential use with the message from the messaging platform 4201. Oneor more recommended hash tags may be presented in a user interface 4210that facilitates user selection and/or approval of one or more of therecommended hash tags. The hash tag(s) may be lined with the message instep 4212, which may produce a message with the selected hash tag thatmay be communicated through the messaging system interface API 4203 tothe messaging platform 4201 where it may be handled according to themessaging platform 4201 protocols.

In embodiments, natural language processing of text content, such as atext portion of a contact event, message, and the like may produce anunderstanding of the text that may indicate a theme, emotion, intent,and the like of the text, which may also apply to the message thatcontains the processed text content. A result of NLP applied to messagetext content may be associated with the message as a form of descriptivemetadata. The result of NLP may also be used to classify messages intocategories of theme, emotion, intent, and the like. In embodiments, amessaging platform that may use hash tags to facilitate access tomessages and the like may benefit from automated tagging of messageswith hash tags indicative of the categories. As an example, a message ina hash tag-centric messaging platform may be processed with NLP todetermine that a theme of the message is armed service personnel and anemotion of the message is respect. A hash tag indicative of thisemotion-based theme may be recommended and/or automatically added to themessage. The NLP-based classification hash tag may be made directlyvisible to users of the messaging platform, or may be hidden from theusers while enabling the platform to better organize and manage messagesbeing exchanged on the messaging platform. The NLP described herein mayfacilitate the creation of hash tag genres—emotion, intent, relevance,popularity, and the like.

In embodiments, in addition to facilitating a sender of a message,contact event, or the like controlling how that message is presented toa recipient on the recipient's computing device user interface (e.g.,which image is displayed, ringtone is played back, video is played backand the like), a platform for providing comparable functionality may beadapted to enable collaboration among senders and recipients on how acontact event and/or message is presented on the recipient's computingdevice user interface. In a simplified two-user example, two users mayshare control of how messages and/or content events are presented oneach other's user interface. Either user may have control of at least aportion of content that is presented in the user interface as a senderand as a recipient. This shared control may be implemented through theuser interface features described herein that facilitate a senderdetermining what image, ring tone, and the like is activated on arecipient's computer interface. However, a recipient may influence,including potentially overriding what the sender has selected forplayback on the recipient's computer. The user in the recipient role mayconfigure his computing device to receive the sender's preference andmessages from the sender, while ensuring that a portion of the messagethat the recipient has control over is defined by recipient settings ordefaults a sender's settings if the recipient has not set anypreferences for or opted to control the portion. In this example, a userin a sender role may indicate a first image to be presented to therecipient; however, a user in a recipient role may indicate a differentimage to be presented to the recipient responsive to the sender'smessage. Further in this example, a user may take on a recipient roleand provide data to the other user's computing device that may restrictwhich images the other user may select among. In this example, theplatform may identify a dozen candidate images based on the processingof a text portion of a message being composed by the sender. However,when the candidate images are presented to the sender for manualselection, only a subset that meets the criteria established by therecipient may be visible and/or selectable. Further in this example, auser in a recipient role may provide a specific list of images, set ofimages, links to a list of links to specific images to a user in asender role that the sender's content matching platform may select fromwhen presenting candidate images to the sender user for selection.

In examples of a recipient mobile device using the methods and systemsdescribed herein, the lock-screen capable application on a recipientmobile phone, computing device, or the like may capture incomingmessages from a wide range of messaging clients (including, withoutlimitation WhatsApp™, Facebook Messenger™, default SMS/MMS messagingapps, and the like) and use processing capabilities including naturallanguage processing (NLP) capabilities to analyze an incoming message'scontent and pair it with a relevant item of content to display on thelock screen of the recipient's mobile device, such as a graphicsinterchange format item (a “GIF”), a video, or any other type of contentnoted throughout this disclosure. The paired content may then play onthe lock screen as part of, or in response to, the message notificationto the user. Continuing with this example, the lock-screen capableapplication may further allow users to respond to the messages they havereceived directly on the lock-screen, without having to unlock the phoneor open a separate messaging application. The user interface of thelock-screen capable application on the lock screen may include a “Tap toview” button that brings users into an interface panel in which the usermay begin creating a response. In embodiments, the phone may remainlocked for all other purposes, so that exiting the interface panelreturns the phone display to its lock screen.

By way of these examples, as the user enters text in the interfacepanel, one or more of at least three response modules may be activated.A plain text response module may be activated to facilitate user entryof a text response and interface with the messaging client, whenapplicable, to which the incoming message was intended. In embodiments,a GIF reply module may use natural language processing to automaticallymatch relevant GIFs (or other such image files) with a user's responsewhile it is being typed, such as based on association of a range of GIFs(or others) with keywords, topics, or the like in a table, database,library or the like that may be accessed to retrieve an appropriate GIF(or other images) based on derivation of the keyword or topic from thenatural language processing. The GIF module may also update theinterface panel with potentially relevant GIFs (or other images), suchas in a portion of the panel, while enabling the user to use a keyboardand also see what he or she is typing. Interface elements (such asswiping left or right, for example) may allow a user to select among thepotentially relevant GIFs and/or to bring up other automatically matchedGIFs (or other images). Alternatively, a gallery of GIFs (or otherimages) may be presented in a portion of the interface panel tofacilitate easier viewing and selection from a range of automaticallymatched GIFs (or other images). Swiping left or right, for example, maybring additional GIFs or the like into view. A video/photo module may beactivated to facilitate a user snapping a photo or video with a camera,such as a camera integrated into the phone, computing device, or thelike to which the user may access through his or her mobile deviceincluding a networked camera and the like. The video/photo module mayalso facilitate the user accessing his or her photo/video library,third-party photo/video libraries, complete SCCMC structures, SCCMCchannels, or image/photo/video content therein, and the like.

Independent of which module(s) are activated to facilitate the userresponding to the intercepted message, the response may be sent back tothe sender's point of origination, optionally through the same messagingclient, the SCCMC app, and the like that the originating message wastargeted for. Thus, the lock-screen capable application may includecapabilities for adapting outgoing communication such that it isappropriate for various channels of communication. The lock-screencapable application may also include capabilities for interfacing withand/or activating one or more communication capabilities or applicationsof the computing device, mobile phone, tablet, and the like withoutrelinquishing the locked state of the device. In examples, if a messagesent from a Snapchat™ client on a sender mobile device is intercepted bythe lock-screen capable application, once the user indicates that aresponse message (with or without audio, GIFs, photos, videos, or thelike) is ready to send, the lock-screen capable application maycommunicate with Snapchat™ application resident on the mobile device, ormay generate a Snapchat™-format response message within the lock-screencapable application, to deliver the response back to the correspondingSnapchat™ application on the sender's mobile phone, computing device,and the like. As noted, in the many embodiments the lock-screen capableapplication may emulate inter-device communication aspects of Snapchat™and communicate directly back to the sender's Snapchat™ application.After the user has completed entry and indicated that the preparedresponse should be sent, the user's display on his or her computingdevice, mobile device, tablet, and the like may return to the lockscreen.

In embodiments, the methods and systems described herein may includeconfiguring a library of audio, video, and image content for use whenprocessing messages and the like as described herein. The library mayinclude items, such as images that may be configured with attributesthat facilitate associating a library item with a message, such as atext message. In embodiments, configuring the attributes may be based onan understanding of messages that the lock-screen capable applicationmay process, such as text messages processed with natural languageprocessing to develop an understanding of a topic, a keyword, asentiment, or the like. In embodiments, attributes may represent aspectsof a message related to the intent of messages, such as an emotion beingconveyed, and the like. Natural language processing of text and othermessages may result in attribute values and types that may be applied toitems in the library. In some examples, applying these attributes andattribute types may be done by a human who reviews the images. In manyof the embodiments, they may be applied automatically by a computerexecuting an algorithm or other methodologies that may determine aspectsof an image, such as a facial expression and the like as beingassociated with an emotion and the like. In embodiments, an automateddetermination may be developed using machine learning such as bytraining a machine learning system using a training set of messages forwhich a human has assigned attributes. In examples, an image of a usersmiling may be associated with an attribute of a happy emotion. Anemotion attribute of such a library item may be populated with one ormore data elements representing an output of natural language processingof text strings that indicates a happy emotion meaning in the text.

In embodiments, methods and systems for creation, use, and maintenanceof media content structures include sender-controlled contact mediacontent (SCCMC) structures, and applications thereof and may furtherinclude adapting, configuring, or the like one or more media contentstructures that are accessible to a recipient computing device,computer, mobile device, and the like including those stored on thecomputing device of the recipient or provided by a server, and the like,during a contact event interaction between a sender computing device anda recipient device. A media content structure, such as an SCCMCstructure, that may be accessed in response to a recipient computingdevice receiving a message, such as a text message and the like from asender computing device may include or reference one or more dataelements, such as an image, video, audio, text content and the like. Inembodiments, prior to presenting the media content structure, such ascontent associated with the sender of the message to the recipient, oneor more of the data elements may be adapted, configured, or replaced byanother data element based on information derived from the sender'scomputing device. The data element, such as an image may be adapted orreplaced by another image to reflect a mood or emotion of the sender. Inexamples, an SCCMC for a sender may include an image of the sender witha pleasant smile. In other examples, however, the sender may be underthe weather, such as due to the common cold, or the like, at the timethat the sender sends the message to the recipient. Based on informationindicative of the sender's state, the pleasant smile image may bechanged to an image that reflects the recipient's state. The replacementimage may come from a portion of an SCCMC structure, from another SCCMCstructure of the sender, from a third-party source, from the sender'scomputing device, and the like. Information about the sender's currentmood, emotional state, health status, and the like may be sent alongwith the message from the sender's computing device to the recipient'scomputing device. In embodiments, the lock-screen capable application onthe recipient's computing device may include an SCCMC application on therecipient's computing device that may process the message andaccompanying information to determine what aspects of the SCCMC to adaptprior to presenting an SCCMC item that corresponds to one or moreattributes of the sender.

In embodiments, a sender may use an SCCMC messaging application tocreate a message that may include information about his or her currentmood and the like. The SCCMC application may provide a user interfacewith features that enable the user to designate his or her mood.Alternatively, a mood determining system, operating on the sendercomputing device, the recipient computing device, or in a remotelocation (such as in the cloud) may rely on technologies that facilitatedetecting the sender's mood, such as facial recognition, speechrecognition, degree of distraction of the sender, and the like. The mooddetermining system operating on the sender computing device or in aremote location (such as in the cloud) may rely on technologies thatfacilitate detecting the sender's mood contemporaneously with the sendersending a message from the sender's computing device to the recipient'scomputing device. The mood determining system may interact with oroperate as part of an SCCMC application, a lock-screen capableapplication, or a combination thereof to provide mood information, whichin turn may be used as an attribute, such as for selection ofappropriate media content structures, such as SCCMC media structures orother media structures, such as selecting a GIF or other image or videothat reflects or is consistent with the mood of the sender.

In embodiments, the lock-screen capable application is an SCCMC-basedapplication and may be part of a platform that may intercept messagesoriginated on a sender's computing device prior to the messages beingdelivered to recipient's computing device, including messages preparedin other messaging applications as described herein. In embodiments, theplatform may process the intercepted messages, including processing themessages while they are being inputted by the sender on the sender'scomputing device independent of which messaging application the senderis using (or none at all), to offer services of the platform to thesender prior to facilitating delivery of the message to one or morerecipients. In embodiments, services offered may include the inclusionof an image, GIF, video, audio, alternate text and the like. Servicesoffered may be customized for the sender based on information known tothe platform about the sender, such as the sender's level of activitywith the computing device, sender's mood, sender's preferences, and thelike. The services offered may be further customized through naturallanguage processing of text portions of the intercepted message and mayinclude suggestions for gifs, images, video, audio, text and the like tobe included with or integrated into the message and the like. Theplatform may, automatically or in response to a sender's acceptance ofone or more offered services, prepare and/or update a content mediastructure, such as an SCCMC structure of the sender, to transmit to theone or more recipients as part of the contact event interaction. As anexample, an updated SCCMC structure or a portion thereof may be sent toa corresponding SCCMC application on the one or more recipient computingdevices ahead of the message to enable the use of the updated SCCMCstructure by a recipient's computing device when processing theaccompanying message.

In further embodiments of a platform, a state determining system, suchas operating with or as part of an SCCMC application or the likeoperating on a sender's computing device, may be provided with or maydetect a current mood, emotional state, health state and the like of thesender and responsively prepare or update a media content structure,such as an SCCMC structure, that may be provided to potentialrecipients, such as currently active users of a group of which thesender is a member. Alternatively, the updated media content structuremay be provided to a platform server that may store the media contentstructure, such as storing it as an SCCMC, such as for use whenfacilitating message delivery during a contact event interaction.Methods and systems for updating SCCMC structures on recipient computingdevices that are described herein may be employed to update the variousrecipient devices.

In embodiments, a contact event handling platform is provided thatintercepts messages originating on the sender computing device frommessaging capabilities or applications operable on a sender's computingdevice, that processes intercepted messages with natural languageprocessing and, based thereon, forwards the message with an appropriatemedia content structure, such as an SCCMC structure, based on theprocessing, and/or a result of the natural language processing. Inembodiments, the contact event handling platform includes a lock-screencapable application that provides a unified messaging user interface fora recipient computing device, such as while the recipient computingmobile device is in lock-screen mode, while also delivering anadaptation of the intercepted message, such as based on the processingthat is compatible with the other messaging applications to the targetedother messaging applications.

In embodiments, the contact event handling platform may intercept, on arecipient computing device, messages destined for other messagingapplications operable on the recipient's computing device. The platformmay process the intercepted message with natural language processing andbased thereon may forward the message, and/or media content structure,such as an SCCMC structure, based on the processing, and/or a result ofthe natural language processing to be processed in a unified messaginguser interface of the recipient computing device, such as while therecipient computing device is in lock-screen mode, while also deliveringan adaptation of the intercepted message based on the processing that iscompatible with the other messaging applications to the targeted othermessaging applications on the recipient computing device.

In embodiments, a lock-screen capable application may facilitateinteracting with a user via user's computing device display while theuser's computing device is locked (e.g., conventionally only thelock-screen may be presented on a mobile device display when the user'sdevice is locked). The lock-screen capable application may, however,facilitate interacting with a user via a user's lock screen orfacilitate interacting with the user on a screen other than the user'smobile device screen, such as a nearby screen on a TV, a screendesignated by the user, a default screen, and the like. In embodiments,the user may interact with the lock-screen capable application via theother screen at least using the user interaction capabilities associatedwith the other screen, such as a touch screen, a touch pad, voiceactivation, keyboard, and the like. In this way, whether or not a user'scomputing device may be in lock screen mode, the lock-screen capableapplication may provide the user with a way to view and respond to amessage being processed through the lock-screen capable application.

In embodiments, a lock-screen capable application as described hereinmay connect to, be associated with, or be integrated with augmentedreality and/or virtual reality (AR/VR) user interfaces. The lock-screencapable application may provide information, such as images, audio,video, text and the like to the AR/VR user interfaces that enablepresentation of a message in the interface. The information may be basedon or include at least a portion of an SCCMC that is controlled by asender of the message. As an example, an SCCMC application operating onor communicating with a computing device in control of the AR/VR userinterface may receive, such as by intercepting a message for anothermessaging platform as noted herein, a message that it processes toaccess a corresponding SCCMC structure. In embodiments, the informationin the structure may include media content, such as images, audio,video, and the like that may be provided to the AR/VR user interface forintegration with the AR/VR user interface presentation. In embodiments,the AR/VR user interface may incorporate active elements, such asavatars and the like that may be deployed in the AR/VR user interface inresponse to receiving the message information from the SCCMCapplication.

In embodiments, the methods and systems of sender-controlled media (SCM)and the like described herein may facilitate enhancing existing callerID functionality with other forms of content including audio, visual,animation, and the like. Use of SCM platform functionality thatfacilitates rendering SCM data structure content and the like through anelectronic display may be integrated with or coupled with existing callfunctionality of smart phones to deliver visual caller ID as a new formof caller ID. Caller ID generally comprises a number or otheralpha-numeric value (e.g., a name) of a caller, such as what may befound in a conventional phone directory and the like. On smart phonedevices that include two dimensional electronic display graphic screens,this information is generally rendered in an incoming call displayinterface. Such an incoming call interface generally provides options tothe user, such as answering the call, sending the call to voice mail,declining the call and the like. Integration of SCM content renderingcapabilities with incoming call interface capabilities may facilitatepresenting a range of content to a call recipient, including real-timeimages of the caller (e.g., through use of a caller's phone's camerafunction and the like). In embodiments, visual caller ID may provide arich form of caller identification while optionally retaining incomingcall recipient options.

As described and depicted herein, SCM content and data structures may becreated and administered by callers using an SCM content creationinterface. This interface may be activated automatically in response toa user initiating a call from a phone equipped with SCM platformcapabilities, such as an SCM content creation application and the like.Such an interface may be adapted to generate call-specific SCM datastructures that can be shared with a recipient at the initiation of acall. Such call-specific SCM data structures may be temporary, existingonly for the initiated call. However, call-specific SCM data structuresmay be created and stored, such as on an SCM platform server and thelike, so that, for example, they can be accessed when the same recipientis called by the caller. In this way creation of a call-specific SCMdata structure may in effect generate a recipient-specific SCM datastructure.

In embodiments, an SCM platform may use the methods and systems ofsender-controlled media (SCM) described herein and depicted in thefigures herewith to, for example, send a video or other forms of mediato a caller in lieu of or in tandem with traditional Caller IDinformation. The platform may thusly overcome an apparent lack ofinformation delivered in a traditional caller ID message thataccompanies a phone call. In examples, the video could be a profilevideo. The video could be a customized video based on an advertiser orretail offering. In examples, the SCM is associated with the caller IDand is linked to a profile in which filters can be set up forpredetermined SCM data structure to be sent to multiple users, e.g.,coordinated call campaigns for retail, affiliated groups(school/job/church calls), etc. In examples, the SCM data structure canbe grouped with a prearranged set of contacts so that it can be sent outto those specific phone numbers, such as when a call is configured to besent to those specific phone numbers in a call queue and the like. Inother examples, the SCM data structure can include and/or refer to anidentity photo or video to facilitate a soft authentication or otherwiseestablish a level of reliability of establishing a connection with thecaller (e.g., increasing a comfort level of the recipient in acceptingthe call). In examples, the SCM data structure can include or referencea registered logo. In examples, the SCM can be a live casting of a faceof a user initiating the call. In examples, the SCM data structure mayinclude an inside joke or shared memory.

Referring to FIG. 43, interface screens for the creation, activation,and presentation of visual caller ID employing the methods and systemsof visual caller ID described herein are presented. In embodiments,creation screen 4302 depicts a visual caller ID creation screen in whicha user is shown an image currently being captured by the user's phonecamera. The screen prompts the user to hold and record a caller IDVideo. The video is captured and optionally associated with an SCM datastructure to be used for a call to be placed by the user. Inembodiments, the screen 4302 may be activated as a result of a userinitiating a call to a recipient; however, the screen 4302 may beactivated separately from initiating a call. The screen 4304 presentsthe user with an opportunity to review the captured visual caller ID,which is a video in this example, but could be an image, a graphic, orother content. The captured video may be saved so that it can bereferenced by the user when generating visual caller ID for other users.The captured visual caller ID may be set at the default visual caller IDfor calls placed by the user. This may be actuated by creating an SCMdata structure for the user that can be presented to the user uponinitiation of an outgoing call so that the user can choose to continuewith the presented visual caller ID or create a new visual caller ID asenabled by the screen 4302. The screen 4306 depicts an incoming callscreen of a recipient of a call from the user. In the screen 4306, thevisual caller ID is presented/rendered/played back depending on the typeof visual caller ID and recipient preferences. The screen 4306 alsoshows traditional caller ID 4308, indicating the possibility of anincoming call screen may be controlled by a traditional caller IDdisplay function (for presenting caller ID 4308) and an SCM-baseddisplay function for presenting visual caller ID associated with thecaller for at least this call instance.

In embodiments, a visual caller generation interface, an embodiment ofwhich is depicted in the screen 4302 may present the user with optionsbased at least in part on call context, such as if a call has beeninitiated to a recipient when the interface is activated. Options duringsuch a condition may enable the user to opt out of sending the visualcaller ID, adjusting an aspect of the visual caller ID, authorizing theSCM data structure platform to adjust aspects of the visual caller ID(e.g., based on an aspect of the recipient and the like). These andother options are described elsewhere herein.

In embodiments, SCM data structures may be created and accessed forcalls to groups of callers. SCM data structures and the like may beassociated with a recipient parameter that may be populated with valuesthat indicate a particular SCM data structure that should be used whenthe recipient is called. In embodiments, a corresponding parameter of arecipient may indicate that the member is part of a call group, such asa member of a team, employee of a company and the like.

In embodiments, SCM data structure content may be utilized incombination with or may replace conventional caller ID. Asender-controller media (SCM) data structure may include content, suchas a video or image and the like, that may be used in a global caller IDprofile of the caller so that the video or image may be rendered on arecipient's phone's electronic display in lieu of conventional caller IDcontent. In embodiments, a global caller ID profile may be stored in thecloud or to other network facilities, to a central node in a network ofsmartphones, or call originating devices and the like. By way of theseexamples, the global caller ID profile may be stored in the cloud to thecentral node, which in some instances can be a cloud hub, for incomingand outgoing calls. The network of smartphones can provide the centralnode capabilities but the central node capabilities can also be offeredby other cloud network systems and providers. In embodiments, existingcaller ID functionality and communication channels may be adapted tofacilitate access to SCM data structure content and the like. Inembodiments, one example of adapting existing caller ID functionality toaccommodate SCM data structure content access may include providing aURL or other link as the conventional caller ID value. In embodiments,the SCM data structure can be delivered in a peer-to-peer fashiondirectly by the call or message originator to the one or more receiversof such call or message. By adapting an incoming call functionality torecognize such a link, the linked content may be rendered as visualcaller ID. In embodiments, incoming call functionality may be adapted torecognize such a link and transfer control of the phone's display screen(e.g., one or both for rendering and receiving user input) to an SCMdata structure processing application that facilitates accessing thelinked content and rendering it for the recipient. Accessing the linkedcontent may include referencing an SCM data structure that has beentransferred to the recipient device through the SCM data structurecommunication methods and systems described herein. In embodiments,initiation of a call from a caller to a recipient may include sendingcall-specific caller SCM data structure information to an SCM datastructure handling application executing on the recipient's phone.Alternatively, initiation of a call may include sending call-specificcaller SCM data structure information to an intermediate server, such asa web server that holds the call-specific caller SCM data structurewaiting for an access request, such as from a recipient phone that hasdetected a link to the call-specific caller SCM data structure in thecaller ID for the initiated call.

In embodiments, visual caller ID functionality may be provided by anexemplary system that may include an incoming call handling functionexecuting on a personal mobile device that may present content from anSCM data structure that is referenced in caller ID data associated withthe call. In such exemplary systems, the caller ID data may be providedto the incoming call handling function of the personal mobile deviceusing existing caller ID techniques and the like. The exemplary systemmay further include an SCM selection interface presented to theoriginator of the incoming call on an electronic interface of a calloriginating device operated by the originator. The selection interfaceor other visual caller ID interfaces may facilitate selection of an SCMdata structure by the originator of the incoming call contemporaneouslywith initiating the incoming call. In embodiments, the selectioninterface may be activated responsive to a user initiating a call. Tofacilitate linking the SCM data structure selected by the calloriginator with the caller ID information sent to the recipient, an SCMlinking function executing on a networked server that receiving aselection of an originator SCM data structure selection from the SCMselection interface (or other visual caller ID interfaces) may form adigital link based on the indication, and may update the caller ID datafor the incoming call with, for example, the digital link.

In embodiments, an alternate exemplary visual caller ID system mayfacilitate generating visual caller identification data. A visual callerID selection interface may be responsive to a user of thecall-originating device initiating a call and causing generation ofoptions for content for a visual caller ID to be presented in the visualcaller ID selection interface. In addition to the visual caller IDselection interface an SCM linking function executing, for example onthe call-originating device, may, in response to receiving an indicationof the visual caller ID from the SCM selection interface (or othervisual caller ID interfaces) form a digital link to an SCMdata-structure based on the indication. Lastly, a caller ID field ofcaller ID for the initiated call may be updated with the digital link sothat the visual content referenced in the SCM data structure can bepresented to the recipient on an incoming call user interface; therebyproviding visual caller ID content and options for handling the call tothe intended recipient.

In embodiments, visual caller ID functionality may be provided through amethod that may include presenting at least one item of content in anSCM selection function of an electronic display of a caller'scall-placing device or other mobile devices. Responsive to the callerselecting an item of content in the SCM selection function, which mayinclude capturing an image or video with the phone's camera interface,the caller's device may initiate a call to a recipient. Also responsiveto the caller selecting an item of content, a link may be generated toan SCM data structure through which the selected item of content isaccessible. Next, the generated link may be used to update caller IDdata for the call, so that the link is provided to the recipient's phoneas a caller ID data value. Upon receipt of the updated caller ID datavalue, the content from the SCM data structure referenced via the callerID data value may be rendered in the call recipients call-receivingdevice electronic user interface.

In embodiments, visual caller ID functionality may be provided through amethod that may include responsive to receiving an indication of arequest to initiate a call from a caller, presenting at least one of animage and a video in a visual caller ID selection user interface of anoutgoing call function of a call-originating device. The visual callerID selection user interface may facilitate generating an indication of auser selection of one of the images, the video, and no selection. An SCMdata structure may next be configured to reference the selection. CallerID data for the call may next be updated to include a link to theconfigured SCM data structure. At the recipient's call-receiving device(e.g., a phone) and responsive to receiving a receipt of the call, thecontent in the configured SCM data structure may be presented on adisplay screen of the call-receiving device by following the link in thecaller identification information.

In embodiments, the methods and systems of visual caller IDfunctionality described herein may be enhanced in a variety of ways,examples of which are not described. In embodiments, the visual callerID interface of the call-originating device may facilitate capturingcontent to be used as the visual caller ID content with a camerafunction of the call-originating device. The captured content may be anyof a still image and a video. The captured content may further bepresented as at least one of the selectable items of visual content inthe visual caller ID interface. In embodiments, a caller ID field of aninitiated call may comprise a link to an SCM data structure. Such as SCMdata structure may indicate an image for presentation on an electronicdisplay of a call receiving device upon receipt of the call. As noted,an item of content to be selected for use in the visual caller ID may bean image captured by a camera function of the call-initiating deviceduring the activation of the visual caller ID selection interface. Inembodiments, the SCM data structure may indicate a video forpresentation on an electronic display of a call receiving device uponreceipt of the call. Also, the SCM data structure may indicate amulti-media object for presentation on an electronic display of a callreceiving device upon receipt of the call. The visual caller IDcomprises a profile of the caller. The visual caller ID comprisespromotional content. In embodiments, a linked SCM data structure mayinclude an image and/or a video captured contemporaneously with theinitiating of the call. Also, in embodiments, the visual caller IDselection interface may further present call originating phone numbersand based on a user selection of one thereof, updating the visual callerID SCM data structure link. Such a function may be useful for a user whooperates a plurality of disjoint businesses to facilitate the userselecting a business by selecting the phone number specific to thebusiness.

In embodiments, visual caller ID methods and systems may be influencedby aspects of a recipient of a call or contact instance, such as acontext of the recipient, a name of the recipient, a group affiliationof the recipient, a characteristic that distinguishes the recipient fromother recipients in a group of recipients, and the like. In embodiments,a recipient-influenced visual caller ID media content object may be anoptional combination of images, text, audio, and video that a user, suchas a participant of an SCM platform as described herein chooses to, forexample, form a template that can be adapted based on recipient contextand rendered when the recipient (e.g., another participant in an SCMplatform environment) is being called by the user. Elements of such atemplate may include a field for the recipient's name, a field for therecipient's group, a field for a group to which the user has assignedthe recipient, a portion for a visual item of content (e.g., where animage of the recipient's face might be disposed), and the like.

In embodiments, configuring and/or using recipient-influenced visualcaller ID may include a computing system, such as a server, a mobilephone of a caller and the like receiving an indication of an initiationof a call from a sender to a recipient. In embodiments, the initiationmay be caused by a user of a call-originating device selecting a contactin a call originating interface. Additional steps for configuringrecipient-influenced visual caller ID may include determining an SCMdata structure for use in configuring visual caller ID for the callbased on a selection of a visual content item by an originator of thecall. In embodiments, the selected item of content may becross-referenced to a library of SCM data structures. An SCM datastructure that is found to include and/or reference the selected item ofcontent may be selected for use with the call. Alternatively, an SCMdata structure generating function may gather information about thecaller, optionally include information about the call (e.g., time ofday, location of the caller and the like), and the selected item ofcontent to produce an SCM data structure for use with the call. Toinfluence the visual caller ID for the call with recipient relatedaspects, an SCM platform participant database may be referenced, such aswith an identifier of the recipient of the call. Such an identifier maybe a phone number of the recipient. Alternatively, the caller may accessthe SCM platform participant database and select a recipient therein,effectively explicitly identifying the recipient entry in the SCMplatform participant database. With the SCM data structure for the calland the SCM platform participant information for the recipient, anadapted SCM data structure may be generated by adapting a portion of theSCM data structure based on an item of information referenced in the SCMparticipant database with the recipient identifier. To complete use ofthe recipient-influences visual caller ID for the call, the caller IDfor the call may be configured with a link to the adapted SCM datastructure.

In embodiments, selection of a visual content item may occur in a visualcaller ID selection interface executing on the call-originating device.Such a visual caller ID selection interface may cause options forcontent for a visual caller ID to be presented in the visual caller IDselection interface so that the caller can complete selection of theitem of content for the call. In embodiments, the options for contentpresented in the visual caller ID selection interface may include animage being provided by a camera of the call-originating device. Tofacilitate generating an image provided by a camera of thecall-originating device, the visual caller ID selection interfaceaccesses the camera and presents content imaged by the camera as one ofthe options for content.

In embodiments, adapting a portion of the SCM data structure toinfluence visual caller ID for a recipient may include adapting arecipient name element of the data structure to correspond to a name ofthe recipient. Adapting a portion of the SCM data structure may includeadapting a recipient group affiliation element of the data structure tocorrespond to a group affiliation of the recipient. Adapting a portionof the SCM data structure may be based on a recipient name. Adapting aportion of the SCM data structure may alternatively be based on a groupaffiliation of the recipient. A call may be made to a plurality ofrecipients, some of whom may be part of a group. For recipients in theplurality who are not part of the group, a different visual caller IDmay be preferred. Therefore, the portion of the SCM data structure maybe adapted based on a correspondence of the name of a recipient to alist of exception names.

In embodiments, calls from business owners to clients, cold prospects,warm prospects, referred prospects and the like may benefit from the useof visual caller ID by tailoring portions of the visual caller ID basedon the client-status of each recipient. As an example, an item ofinformation for the recipient referenced in the SCM participant databasemay indicate a client-status. Based on that indication, a client messageportion of the SCM data structure may be adapted. Exemplaryclient-status and resulting client message portion adaptations mayinclude the recipient is an existing client so the message to thisrecipient would refer to an existing relationship between the caller andthe recipient; the recipient may be a referral from an existing client,so the message to the recipient may reflect this referral, the recipientmay be a prospect without referral so the message to this recipient maybe a non-referral prospect message.

In embodiments, visual caller ID content may be adapted based on callcontext, such as a time of a call, a date of a call, a proximity to aholiday or other event, a proximity in time to an upcoming meetingbetween the caller and the recipient, a location of the caller, alocation of the recipient, an intent of the call, and the like. Adaptinga caller ID content, such as visual caller ID content dynamically (e.g.,at time of the call) may be based on call-specific context (e.g., otherthan recipient context, and the like). In embodiments, a specific callerID content may be automatically selected based on the call-specificcontext. Adjusting a portion of the content, such as an image, an objectin an image, and the like may be based on call-specific contexts, suchas time of day, time remaining before an offer ends (e.g., salespromotion), and the like.

In embodiments, methods and systems for call context-based visual callerID content may involve performing actions related to the visual callerID (e.g., selecting, generating, adapting, and the like) upon receivingan indication of an initiation of a call from a sender to a recipient.Alternatively, the performing the actions may be associated withconfiguring a call queue of recipients, such as for automated callingand the like. For time-based call context an amount of time left in anoffer related to the call, such as an offer from the sender to therecipient, an offer from a third-party to the sender and/or therecipient, timing of offers available to but not specifically for thesender, recipient or both, and the like. Other related time-basedaspects of a call context may be time until an upcoming event or elapsedtime since a prior event, such as a public event, a private event, anevent detected on a calendar of at least one of the sender and therecipient. Yet other call time-based aspects that may impact visualcaller ID may include a day, date, time-of-day and the like of the call.Based at least in part on the time-related context of the call, methodsand systems for call context-based visual caller ID content may involvegenerating an SCM data structure that may impact the visual caller IDfor the call.

In embodiments, an SCM data structure may be generated from the profileand related information for one of the call participants, such as thesender and the recipient and the like. The SCM data structure may alsobe configured from call context information, such as a location of thesender, and/or the recipient, a time/day/date of the call, an intendedduration of the call, a product or service associated with the call, amessage of the call, and the like. In an example of adapting visualcaller ID based on time of day, an image may be adapted to reflect acurrent time of day by adjusting the overall tone of the image tocorrespond to an amount of daylight. For daytime calls, the tone may belightened, for evening or night calls, the tone may be softened.Generating an SCM data structure may occur contemporaneously withinitiation of the call by the caller, such as by the caller using thecamera function of the call-originating device to capture an imageand/or video of the caller that can be used at least in part in the SCMdata structure, such as a display content portion of the SCM datastructure. The SCM data structure may also be generated by adapting aportion of an existing SCM data structure based on the amount of timeleft. To effect use of the SCM data structure content and the like asvisual caller ID content, a caller ID data element for the call may beconfigured with a link to the generated SCM data structure. Use of theSCM data structure by a recipient call receiving device (e.g., asmartphone and the like) may be accomplished by an application executingon the recipient device accessing the SCM data structure through thereceived caller ID information such that the SCM data structureindicates an image, graphic, video, rendering, handwritten note, and thelike for presentation on an electronic display of a call receivingdevice upon receipt of the call. The SCM data structure may include amulti-media object (e.g., an animated cartoon with caller voice over andthe like) to be presented on the recipient's call-receiving device uponreceipt of the call. In embodiments, the image may be an image capturedby a camera function of a call-initiating device that was capturedcontemporaneously with the initiation of the call. A call time-adaptedSCM data structure may include a profile of the sender (e.g., calloriginator, party that the sender represents, and the like), promotionalcontent (e.g., that the caller, optionally acting as a representative,offers to the recipient), and the like.

The examples above of visual caller ID content generation, delivery anduse may include functionality such as sending an SCM data structureand/or a link thereto with and/or in place of traditional caller IDinformation. This disclosure includes descriptions of a range of formsof SCM data structure content; any such form may be included in thesemethods and systems of visual caller ID. In embodiments, the methods andsystems of visual caller ID may utilize some existing channels, such asa caller ID channel that conventionally is controlled by a third party,such as a telephone call service provider, and the like; however, thevisual caller ID may be controlled through these methods and systems bythe caller/sender rather than a third-party. This capability supports acaller communicating information such as a profile, advertisement,retailer content, and the like as a form of caller ID. As describedherein, an SCM data structure used for providing visual caller ID to arecipient for a call may be linked to an existing caller ID for acaller, such that the caller ID may be used as, for example, a link intoan SCM data structure database through which a corresponding SCM datastructure and/or visual caller ID content may be accessed forpresentation to a recipient of an incoming call. Caller ID-based accessto visual caller ID SCM data structure content may support a callerselecting an originating phone number for a call that may be differentthan the native phone number associated with a call-originating deviceof the caller. In this way, for example, a caller may initiate automatedcalling to one or more recipients with visual caller ID contentdedicated to different call-originating numbers. As an example, a brokerof insurance services may select an originating phone number for a firstinsurance provider for a call from the broker to clients of the firstinsurance provider and select for a second call an originating phonenumber of a second insurance provider for a call to, for example,prospects of the second insurance provider. Also, as described in theexamples above, visual caller ID content may be impacted by and/orcombined with recipient-related information. One such example of visualcaller ID impacted by recipient-related information occurs when arecipient is part of a group (e.g., member of a church, job, school,business, professional group, and the like). A group-affiliation of therecipient may be used to adapt and/or otherwise impact the generation ofan SCM data structure for the call, such as changing a logo or the likepresented as visual caller ID to reflect the group affiliation, and thelike. For retail examples, visual caller ID may automatically be adaptedbased on a relationship between a caller and a recipient. A messagerelated to the caller may be changed based on, for example, a recipientbeing an existing client of the caller, the recipient being a referralto the caller, the call going to a new prospect (e.g., a cold-call) andthe like. In embodiments, the caller may be associated with a profileand an SCM data structure used for providing visual caller ID to arecipient for the call. By way of these examples, the caller may beassociated with the profile that may be from a single phone or calloriginating device but that phone is associated with at least two (ormultiple) subscriber identification modules, SIM cards, or otherelectronic devices onboard or insertable that can control theidentification of the phone. In these examples, the caller may beassociated with the profile that is specifically associated withmultiple subscriber identification modules or the like so even thoughthe caller may appear to have multiple phones or call originatingdevices, the caller with their multiple subscriber identificationmodules or the like can appear to be from a single source whenassociated with the one or more specific SCM data structures used forproviding visual caller ID.

In embodiments, methods and systems of visual caller ID, such as SCMdata structure-based methods and systems may support a user setting upcontent, such as video, audio, text, image, multi-media and the like aspart of a temporary visual caller ID that expires, such as after acertain amount of time, related to an event, and the like. Inembodiments, this allows users to have a visual caller ID that expressesa feeling or mood for a certain amount of time before it reverts to whatpreviously was set as their profile visual caller ID. This temporaryvisual caller ID can be accessible to specific contacts, groups, or allrecipients.

In embodiments, methods and systems of temporary visual caller IDcontent generation and use may include configuring, such as with avisual caller ID interface executing on a call-originating device,temporary content for visual caller ID for calls initiated by a user ofthe call-originating device. An SCM data structure with the temporarycontent may be generated from an existing SCM data structure by copyingthe existing SCM data structure and including a temporary item of visualcontent in place of existing visual content. An existing SCM datastructure may be configured with control data fields that may facilitatemarking a time/duration of a link to temporary visual caller ID contentwhile retaining a link to the content that will be accessed and uses forvisual caller ID once the temporary content expires. A functionexecuting on, for example, the caller's call-originating phone or aserver through which calls from the caller are routed, may uponreceiving an indication of an initiation of a call by the caller, accessthe (temporary) SCM data structure for the caller and present thetemporary item of visual content or an existing item of visual contentas visual caller id to a recipient of the call. The function maydetermine which visual caller ID content to present based on arelationship between a current time, such as a time of the call and atime-limited use parameter of the temporary item of visual content. Inembodiments, configuring visual caller ID comprises configuring an SCMdata structure with at least one of a link to the temporary item ofvisual content and the temporary item of visual content. In an example,the relationship between a current time and a time-limited use parameterof the temporary item of visual content may include a time remaining foruse of the temporary item of visual content. The relationship may be ause status of the temporary item of visual content. In examples, thetime-limited use parameter of the temporary item of visual content mayinclude an expiration date for use of the temporary item of visualcontent; the parameter may include a use start date and a use end datefor use of the temporary item of visual content. Other forms oftime-limited use parameter may include a calendar date, a pre-dateduration of use prior to the calendar date and a post-date duration ofuse of the temporary item of visual content after the calendar date, alink to an entry in a digital calendar of the user of thecall-originating device and the like. For embodiments in which SCM datastructure content may be distributed among various servers and edgedevices, such as to facilitate faster access to the content for incomingcalls, the methods and systems of temporary visual caller ID content usemay include updating the caller ID function system wide, such as withexpiration criteria.

In examples, time of temporary items of content for visual caller ID usemay be limited so that the content may be good until a duration of timefrom a first-use time, may be good until an event and the like. An eventmay be a specific time in the future, such as a scheduled meeting andthe like. An event may also be based on an asynchronous trigger, such aswhen a user clocks out of work for the day. An event may also bedescribed conditionally, such as based on a candidate getting elected toan office. Conditional events may be used for activating temporarycontent as well, such as changing the title of the caller based on aresult of an election and the like. In further examples, conditionalevents may include locations of the caller, changes to the location ofthe caller, one or more reoccurrences of the caller being in certainlocations, or the like. In embodiments, conditional events may include arelationship status of the caller, changes to the relationship status ofthe caller, time between changes of relationship statuses of the caller,changes in relationship statuses on the receiving and sending end of thecall, or the like. In embodiments, conditional events may include abirthday of the caller, proximity of the caller's birthday to certainage ranges or a minimum age, a birthday used in age verification,proximity to other users with similar or identical birthdays, or thelike. In embodiments, conditional events may include a holiday relevantto the caller or any caller, proximity of the caller's birthday tocertain holidays, a holiday relevant to the caller's identifiedreligious, social, or familial affiliations, proximity to other userswith similar interest in a holiday relevant to the caller, or the like.

In embodiments, such as a multi-call/call group-based program, visualcaller ID may be adapted for select recipients. Caller ID and relatedcontent may be configured, selected, and/or adapted, such as by editingan SCM and the like with one of several options when contacting a groupto effectively configure an SCM for individual recipients in the groupbased on, for example, a recipient relationship to the group. In anexemplary automated calling program, caller ID content, such as visualcaller ID content and the like may be adapted for select recipients.Caller ID may be adapted based on, for example, a context of arecipient's membership in the call-group, if the recipient is an SCMplatform user, and the like.

In embodiments, methods and systems for recipient-specific caller ID(e.g., SCM data structure) adaptation may include, among other things,detecting initiation of a first call from a first caller to a firstrecipient of a recipient call group. Using at least existing caller IDdelivery mechanisms, the call may cause visual caller ID contentconfigured based on characteristics of the recipient call group to beaccessible by a call receiving device of the first recipientcontemporaneously with receipt of the first call by the call receivingthe device. In this way, visual caller ID content that is specific to acall group, such as content described in a sender-controlled media datastructure associated with the group, the caller, or the combinationthereof, may be provided to at least one of the recipients in the callgroup. As calls to the recipients in the group progress, informationabout the caller, the recipient and the group may be processed for thepurposes of generating recipient-specific caller ID information. Inresponse to detecting initiation of a second call from the first callerto a second recipient of the recipient call group and based on acomparison of a characteristic of the recipient group and acorresponding characteristic of the second recipient, visual caller IDcontent that may be different than the group visual caller ID contentmay be used for the call to the second recipient. Such as action may beaccomplished by indicating a first SCM data structure for the group anda second SCM data structure for recipients for whom, while members ofthe group, the group SCM data structure is not suitable. An example mayinclude a group that includes adults and children. Some messages thatmay be suitable for adults may not be suitable for children in thegroup. Rather than sending a child-suitable message to all members ofthe group, the recipient-differentiated caller ID content methods andsystems enable sending recipient differentiated caller ID content to agroup of recipients.

In embodiments, the visual caller ID content may be made accessible to acall receiving device of the recipient as a link (e.g., a URL to anetwork-based location) to an SCM data-structure that comprises at leastone of the visual caller ID content and a link thereto. For suchembodiments, multiple SCM data structures may be configured at thenetwork-based location so that the only piece of differentiatinginformation delivered to the recipient's phone in the call is a link tothe recipient-specific SCM data structure. Processing of the SCM datastructure can be the same for all recipients, with the content in therecipient-specific SCM data structure being rendered for the recipient.Therefore, a link to an SCM data-structure may be provided to the callreceiving device as caller ID information. To facilitate presenting thevisual caller ID content for the recipient timed so that the recipientcan view the caller ID content as the call connection is beingrequested, the visual caller ID content is made accessible to the callreceiving device as a link in an SCM data-structure that is provided tothe call receiving device contemporaneously with receipt of the call. Asdescribed herein, a characteristic that may distinguish a recipient fromother recipients in a group may be a group affiliation identifier. Tofacilitate differentiating members of a group, a correspondingcharacteristic of the second recipient may be a status of groupaffiliation of the recipient with the recipient group, such as is themember a long-term member, a temporary member, a trial member, a newmember, a junior member, a fee-free member, a paying member, and thelike.

In embodiments, configuring visual caller ID content for the secondrecipient may include adjusting at least one element of the visualcaller ID content that is based on the characteristics of the recipientgroup and further based on a result of the comparison. As an example,the element of visual caller ID content that may be adjusted may be alogo for the general group caller ID content, whereas a message in thevisual caller ID content may be adjusted (optionally along with thelogo) for recipients who are exceptions to receiving the group visualcaller ID content. As another example, the corresponding characteristicmay distinguish the second recipient from at least one other recipientin the call group. Other examples include the characteristic of therecipient group indicating business contacts and the recipient-specificdistinction indicates whether the recipient is an internal or externalbusiness contact, so that a confidential message for internal contactsis not delivered as visual caller ID content to an external businesscontact.

In addition to recipient-to-recipient differences, the correspondingcharacteristic for differentiation of the second recipient may be astatus of the second recipient with respect to an object of the secondcall; such as if the call is to recruit members to a group, priormembers of the group may receive a different message than recipients whowere not prior members of the group.

Generating group-specific visual caller ID content for recipients forwhom the group caller ID content is suitable, may include configuringvisual caller ID content based on characteristics of the recipient callgroup by selecting a first caller visual caller ID content and adaptingthe first caller visual caller ID content to reflect the characteristicsof the recipient group. This is exemplified by, in embodiments, an imageof a recent group meeting that may be changed for calls made to membersof the group who were in that group meeting. Continuing further,configuring visual caller ID content for the second call may further bebased on an identifier of a user actuating the initiation of the firstcall, an objective of the call, a time of the call, and/or an aspect ofa call-receiving device of the recipient. In embodiments, configuringthe visual caller ID content may be based on a characteristic of thecall receiving device. Such a characteristic may be selected from thelist of call receiving device characteristics including, withoutlimitation, device storage capacity, device screen size, deviceoperating mode, and availability of a sender-controlled media (SCM)application on the call receiving device.

In embodiments, in addition to conventional caller ID delivery channels,visual caller ID content may be made accessible to the call-receivingdevice by transporting at least one of the visual caller ID content anda link thereto over a short-message-service connection to thecall-receiving device. Similarly, the visual caller ID content or a linkthereto may be transported over an iMessage channel linking the firstcaller with the call-receiving device.

In embodiments, an SCM data structure may be adapted forrecipient-specific exceptions at the recipient call-receiving device. AnSCM data structure processing application may process the SCM datastructure identified in the caller ID data, for example, and adapt itwith recipient-specific content, such as from a profile of the recipientbased on, for example certain fields in the SCM data structure beingmarked as optional and/or as conditional based on the recipient'srelationship to a group, and the like.

In embodiments, a group SCM data structure, including visual caller IDitems of content and the like may be created automatically on acomputing device, such as a server that has access to group-specificinformation, such as a member list of members of the group, conditionsfor determining when a member on the member list should not receive thegroup visual caller ID content, and the like. A group SCM data structuremay be configured, selected, adapted, and the like at a server, at asender's call-originating device, at a recipient's call-receiving deviceand the like.

Other factors that may impact visual caller ID content may be related toa network over which the call is being placed, such as network speed,location of an SCM data structure relative to the recipient, user devicecharacteristics, such as storage capacity, screen size, mode ofoperation, parental controls present on the device, and the like.

In embodiments, a call-originating interceptor function may allowoverriding pre-arranged single profiles or contact groups establishedfor group contact (e.g., group emails, group texts, etc.) and the like.Such an interceptor function may facilitate avoiding a classic problemof an unintended “reply all” situation. When originating the groupcontacts (or even a single contact) to which an existing SCM datastructure is assigned or when a pre-arranged SCM data structure exists,the initiator may be directed to a specific screen that interruptssending the prearranged SCM. The screen may be configured to requireconfirmation whether that SCM should be used for this call to arecipient or to all recipients in the case of multiple recipients (e.g.,group texts and the like). In examples, the user may be presented with askip button that may, for example, remove the recipient from the groupcontact, cancel the message when to a single user, curate the list towhom the message is to be sent, and the like. In further examples, acontact originator may be reminded of (i) the specific SCM to be usedfor this contact/sent to this group, (ii) the size of the group, and(iii) the option to skip the recipient, the use of caller ID, the use ofthe specific SCM and the like.

In embodiments, generating visual content on the fly, such as visualcaller ID content for calls placed from a smartphone, computer and thelike and SCM data structure content for presenting to a recipient of adigital contact, such as a message, text, video call, and the like mayfacilitate contact-time differentiating of contact-initiating contentfor one or more recipients, such as when contacting a group ofrecipients some of which the caller may prefer to exclude from receivinga generalized group-directed contact initiating content, such as a grouptext message and the like. In embodiments, generating visual contactcontent on the fly may be facilitated by an initiated contact interruptfunction that presents to the contact originator (e.g., a contactsender, caller and the like) options for one or more recipients prior tothe one or more recipients being notified of the pending contact/call.In a call-based example, such a contact interrupt process may beactivated for operation on a caller's call-originating device inresponse to detecting initiation of a call that causes visual caller IDcontent to be accessible to a visual caller ID rendering functionexecuting on a call receiving device. The interrupt process may includepausing delivery of the call until a call delivery signal is detected,such as a signal from the caller to proceed with the call using visualcaller ID content selected for the call. The interrupt process may,while pausing delivery of the call, present a visual caller IDconfiguration user interface to the caller. The visual caller IDconfiguration user interface may be configured to enable selection ofvisual caller ID content for the call from, for example, a plurality ofvisual caller ID content options. By way of these examples, the visualcaller ID content options may include: existing content, at least onealternate content, and generation of content via a camera and/ormicrophone function of the call originating device. In embodiments, thevisual caller ID content options may be emojis. In embodiments, thevisual caller ID content options may be gifs including gifs withembedded motion. In embodiments, the visual caller ID content optionsmay be jpegs or other image content. In embodiments, the visual callerID content options may be stickers, labels, and the like. Byinterrupting a call before it reaches the recipient, (optionally beforeit is initiated by the call-originating device), the caller may be ableto influence the visual caller ID for the call by selecting content (orexclude content). The selection may result in a call delivery signalbeing generated and the selected item of content being communicated tothe recipient. In embodiments, the selected item of content can be anemoji. In embodiments, the selected item of content can be a gif. Inembodiments, the selected item of content can be stickers or labels. Theselected item of content may be null. The selected item of content maybe one of an emoji, a gif, and a sticker. The interrupt function mayactivate a visual caller ID configuration user interface that may useaudio/video recording capabilities of the caller's device to configurethe visual caller ID content. The visual caller ID configuration userinterface may include an option for designating the selected visualcaller ID to be used for calls made to the recipient. The interface mayalso present an indication of visual caller ID content in an SCM datastructure as the existing content. The existing content may includecontent that is recipient-specific. The existing content may be adaptedon the fly for the recipient via the interrupt function and optionallyvia the visual caller ID configuration user interface. In embodiments,existing visual caller ID content may be designated for calls made bythe caller to members of a group of which the recipient is a member. Inan example, the call may include multiple recipients with the existingcontent being designated for a caller-group comprising the multiplerecipients. Other examples include single recipient calls. The interruptfunction facilitates causing the user selected content option duringpausing of the call to be used as visual caller ID content for a subsetof the recipients. Recipients for this subset of recipients may beselected by the caller during, for example pausing of the call.

In embodiments, pausing the delivery of the call may be based on acharacteristic of the recipient, such as a relationship between therecipient and a group of recipients to whom the call is directed. Inembodiments, an interrupt function may include detecting initiation ofthe call on the caller's device; the interrupt function further causesthe pausing of delivery.

Referring to FIG. 44, an interrupter screen is depicted for supportingthe methods and systems of on-the-fly visual caller ID contentadaptation, generation, and control for outgoing calls, which mayinclude calls to a group of callers some of whom an existing visualcaller ID is not suitable. While the embodiment of FIG. 44 depicts auser calling a recipient, the methods and systems of interruptingoutgoing SCM data structure content delivery may apply to any type ofelectronic contact, including without exception emails, text messages,videocasts, video calls, and the like. The screen 4402 depicts oneoption for interrupting delivery of an SCM data structure to arecipient. In this option, a user has initiated a call to a recipient.This creation screen 4402 may result from (i) no SCM data structure forthe caller available, (ii) the user has indicated in a prior screen ofthe interrupter methods and systems to generate a new, and optionallytemporary visual caller ID, (iii) the user indicated or accepted arecommendation from the SCM data structure platform to not use anexisting visual caller ID for this call to this recipient. The screen4402 provides the user with several options for generating visual callerID, such as typing a message, selecting an emoji, recording a video, andthe like. The screen 4404 depicts an incoming call screen of therecipient in which visual caller ID generated and/or selected in thescreen 4402 is presented to the recipient along with an option to acceptthe call 4406 as well as conventional caller ID 4408.

In embodiments, visual caller ID methods and systems may includegenerating in real time and using, as visual caller ID SCM datastructure visual content that is contextual to audio/text recordedon-the-fly (e.g., during initiation of a call), such as by determiningan intent of the recorded audio/text and selecting visual content basedon that understanding. As an example of call content-based visual callerID, a method may include detecting initiation of a call from a caller toa recipient and pausing delivery of the call until a call deliverysignal is detected. While pausing delivery of the call, the method mayinclude producing the visual caller ID content by a sequence of stepsincluding: (i) capturing live content comprising at least one of audioand text input to a call-originating device by the caller; (ii)processing the captured live content to determine an intent of the livecontent; (iii) automatically selecting a visual element based on theintent, combining the selected visual element with the live contentthereby producing the visual caller ID content; and (iv) and generatingthe call delivery signal for delivery of the call. Processing thecaptured live content may include audio to text conversion of thecaptured live content. The processing may further include naturallanguage processing (NLP) of a least one of the captured text and thetext converted from the captured audio to determine at least one of anintent of the call, a subject of the call and an action of the call. Inembodiments, automatically selecting content may be performed by avisual content selection algorithm that performs, among othertechniques, the best fit of a visual content item to the determinedintent, action, or subject. The intent in such content may be based on arecipient of the call, a relationship of the recipient to a group ofrecipients associated with the call, such as a group of call recipients,and the like. As part of the methods and systems for generating contextbased on call content, pausing the call may be based on a range ofaspects related to the call, such as a characteristic of the recipient,which may be a relationship between the recipient and a group ofrecipients to whom the call is directed.

In embodiments, a storytelling feature of the methods and systemsdescribed herein may allow users of an SCM platform who are having aconversation to receive suggestions of SCM to deliver in tandem with theconversation being exchanged by the users. Various methods and systemsfor understanding content, such as machine learning, natural languageprocessing and the like may be applied to sense characteristics of theexchange that can be used as storytelling information for suggesting SCMcontent, such as in a paneled storyboard fashion for being added to theconversation and the like.

In embodiments, a message, such as a text message that may be part of atext exchange between users may be intercepted as it is being sent froma first user in the exchange to a second user in the exchange.Intercepting facilitates developing an understanding of the message withnatural language processing, the understanding further used tofacilitate making suggestions for video/image/audio of an SCCMC to beassociated with the message.

Suggesting video/images/audio and the like based on an understanding ofa message exchange may facilitate storytelling. Other sources ofsuggestions and evaluations of suggested content may include socialmedia. In embodiments, social media-based perception of the combinationof text and the particular image may support the suggestion (e.g.,social media users may indicate a preference for the combination, suchas by liking the message or taking another action, such as reposting themessage), or may indicate the suggested image may not be a suitableimage for the text (e.g., social media users may indicate a dislike forthe combined image/text, such as by disliking the message or exhibitinga lack of action such as not reposting the message).

Visual content suggestions, such as videos and images as well as audiocontent and the like may be a result of natural language processing ofan exchange among users. In an example, NLP may be used to analyze amessage text content to generate a context or understanding of themessage. In embodiments, such an understanding may suggest that a senderis inviting a recipient to a sporting event. The understanding may becoded into keywords, such as team, invitation, and the like that may beuseful for indexing into a gallery of photographs of the sender and/orrecipient. Images that are indicated by the keywords to be similar tothe NLP understanding of the message may be suggested for use with themessage. As an example, an image of the team mentioned, along with aschedule showing the date of the event and the competitor being playedmay be suggested for the purposes of enhancing storytelling.

In embodiments, the context of one or more participants in an electronicexchange between users of an SCM data structure platform may be usefulon enhancing storytelling, such as by suggesting images and the like toinclude in the exchange. One such context is the current mood of one ormore of the participants in the exchange. As described herein,sender/recipient state detection functionality may facilitate detectinga mood of a participant in an electronic exchange. Methods and systemsdescribed herein may include a method that may include adapting an SCMdata structure in response to receiving an indication of a current stateof a sender or a recipient in a digital exchange. The SCM data structuremay be useful in facilitating storytelling by being adapted as describedherein with images and the like suitable for convening, for example, themood of the sender and/or recipient. Techniques such as facialrecognition of the sender or recipient as well as processing the contentof the exchange to develop an understanding may adjust content matchingparameters so that rather than selecting an image of the sender andrecipient smiling, selecting one where the participant without the happymood is not smiling.

In embodiments, a platform of users, such as participants in an SCMplatform may generate information about callers, such as unknowncallers, that may be useful for other users of the platform whendeciding how to respond to requests for connecting to an unknown caller.Information gathered about calls from the caller to other recipients maybe stored in a caller identification and evaluation database that may bemade available for update and use by participants in a platform orgroup, such as a group of uses of the SCM platform. This database may beindexed by, for example, caller ID information provided by a callconnection network about the callers. The database may include publicnumber search information, further search information derived from theresults of a public number search, such as criminal records, other phonenumbers, names, addresses and the like of potential callers and thelike. Public number search results may be communicated to participantsof the platform and the like for validation and/or determining relevanceto an evaluation of the caller. Additional information, which may begathered from platform participants may include call trackinginformation for prior calls from the caller. Platform participants maygenerate caller evaluation data, such as in response to requests forevaluation of unknown callers and the like. Caller evaluation data mayinclude thumbs up/thumbs down regarding a usefulness, applicability,spammer status, and the like. In embodiments, enhancing informationabout unknown callers may include generating a profile, such as an SCMdata structure, for unknown callers based on information gathered aboutthe caller from internal and external data sources. Such a profile maybe generated in response to receiving an indication that a caller who isnot a participant of an SCM platform is calling a participant of theplatform. This automatically generated profile may be embodied as aportion of an SCM data structure associated with the caller ID of theunknown caller. Upon subsequent calls from the unknown caller, the SCMdata structure for the caller may be processed by the recipient SCM datastructure processing software (e.g., an app on the recipient's phone)for the purpose of presenting visual caller ID content of the caller toa recipient; thereby providing the recipient context regarding theunknown caller that would not otherwise be readily available at the timethat a call from the unknown caller is incoming.

In embodiments, when a user of an SCM data structure handling platformis receiving a phone call (text message, email and the like) fromsomeone who is not a user of the platform, the platform can provide muchinformation that is available and aggregate it into informationdelivered as an SCM data structure for the caller to the recipient. Theinformation in the automatically generated caller-specific SCM datastructure can be used to better identify the unknown caller and caninclude content readily available on the Internet including socialmedia, any information available from point of sale systems associatedwith the platform, any information available from other caller/userinteractions on the platform and the like. In examples, specificinteractions with others on the platform can supplement information toidentify, or at least better identify the unknown caller. In examples,this functionality enables platform users to avoid spam calls. Forexample, a phone call from a restaurant to a user of the platform couldhave caller ID for the restaurant be adapted through Internet searchesof the restaurant to include a photo or video from the restaurant'swebsite or social media presence serve as their visual caller ID. Inexamples, an incoming call from a ride-sharing service can cause visualcaller ID content to be adapted based on an active request for theride-sharing service that is associated with the recipient's phonenumber to show information from the request, such as a live map andpicture of the driver with the vehicle as part of an SCM data structurereferenced through the caller ID data, and the like.

In embodiments, an unknown caller information improvement method may beactivated by receiving an indication that a caller who is not aparticipant in a sender-controlled media (SCM) platform has initiated acall to a recipient who is a participant of a sender-controlled media(SCM) platform. The information improvement method may include usingcaller ID information provided with the call to gather contentpertaining to the caller from a plurality of sources includinginformation available in data stores of the platform, public numbersearch information and the like. The gathered information may be used togenerate a sender-controlled media (SCM) data structure for the caller.This automatically generated SCM data structure may be delivered to acall receiving device of the recipient whereat visual content of the SCMdata structure may be presented to the recipient, such as through avisual caller ID interface on the call-receiving device. By encouragingplatform participants to provide their opinion and/or observations abouteach caller to a participant of the platform, information available indata stores of the platform may include information collected regardingcalls from the caller placed to other participants of the SCM platform.This information may be used, optionally along with unverifiedinformation provided by platforms members and others about the caller toinform an SCM data structure generation process for the caller.

In an example, the information available in data stores of the platformcomprises ratings of the caller made by participants of the SCMplatform. Once an SCM data structure for the unknown caller is created,it may be associated with the caller so that future calls from thecaller may facilitate accessing the generated SCM data structure. Inembodiments, rather than sending the existing caller ID information to arecipient device, the generated SCM data structure may be provided tothe call-receiving device using, for example, one or more of the visualcaller ID delivery methods described herein. This may be accomplished byreplacing an existing caller ID information, if any, with a link to thegenerated SCM data structure. As a way for enabling the recipient of acall from an unknown caller to take advantage of the informationgathered and evaluations made by other platform participants, agenerated SCM data structure for the caller may be provided to an SCMplatform application executing on the call receiving devicecontemporaneously with the incoming call.

In embodiments, handling unknown callers with an SCM data structureplatform may facilitate taking an action toward the caller, such assuggesting that the caller join the platform, such as by providing anaudio message while attempting to complete the call, or by sending atext message to the caller contemporaneously with the call (e.g., whileattempting to complete the call, while waiting for the recipient to makea decision regarding accepting the call, while the accepted call is inprogress, at completion of the accepted call, at another time).

In embodiments, methods and systems for handling unknown ornot-well-known callers may include generating SCM data structurecontent, such as an audio message that is presented to the unknowncaller contemporaneously with a call being placed by the caller to arecipient. The content may be relayed to the caller's call-originatingdevice at various times related to the call, such as prior to the callbeing presented to the recipient in an incoming call handling userinterface of the recipient's call-receiving device (e.g., therecipient's smartphone), while the call is presented to the recipientfor accepting or rejecting the call, during the call (e.g., after therecipient has indicated acceptance of the call), as a result of therecipient rejecting the call, at a time designated by the recipientduring or immediately after the call ends (e.g., by the recipientindicating in an unknown caller handling interface screen to send one ofa plurality of types of messages to the caller), upon conclusion of thecall, and at another time, such as when the next time a call from thecaller is processed by the platform.

In embodiments, a method for handling unknown or not-well-known callersmay be initiated by receiving an indication that a caller who is not aparticipant in a sender-controlled media (SCM) platform has initiated acall to a recipient who is a participant of a sender-controlled media(SCM) platform. The call may include caller ID information that may beused to facilitate gathering content pertaining to the caller from aplurality of sources including information available in data stores ofthe platform and public number search information. This gatheredinformation may be used as a basis for automatically generating asender-controlled media (SCM) data structure for the caller, which mayinclude visual and/or audio content, a portion of which may be deliveredto a call originating device of the caller. The portion delivered to thecall originating device may be delivered as a ring-back tone, as an SMSmessage, as an MMS message, and an iMessage, as a traditional voicemail,as visual voicemail, and the like. In embodiments, the content deliveredto the caller's call originating device may include an offer and/orinstructions to join the SCM data structure platform, such as tofacilitate easier access to platform participants, and the like.

In embodiments, methods and systems for handling calls to platformrecipients by unknown or not-well-known callers may include generatingcaller ID-specific SCM data structure content to be used as visualcaller ID for the recipient and caller-directed content that may bestructured as part of the caller ID-specific SCM data structure or acaller ID-directed SCM data structure so that the caller-directedcontent is delivered to the caller, such as to the caller'scall-originating device. An exemplary method may be initiated byreceiving an indication that a caller who is not a participant in asender-controlled media (SCM) platform has initiated a call to arecipient who is a participant of a sender-controlled media (SCM)platform. Any caller ID information associated with the call may be usedto facilitate gathering content pertaining to the caller from aplurality of sources including information available in data stores ofthe platform and public number search information. A first SCM datastructure may be automatically generated for sending to the recipientbased on the gathered content. A second SCM data structure may beautomatically generated for sending the caller based on the gatheredcontent and both the first and second SCM data structure or a contentportion thereof may be delivered to the recipient and callerrespectively.

The automatically generated first SCM data structure may be delivered toa call receiving device of the recipient whereat visual content of thefirst SCM data structure may be presented to the recipient, such asthrough a visual caller ID interface on the call-receiving device. Byencouraging platform participants to provide their opinion and/orobservations about each caller to a participant of the platform,information available in data stores of the platform may includeinformation collected regarding calls from the caller placed to otherparticipants of the SCM platform. This information may be used,optionally along with unverified information provided by platformsmembers and others about the caller to inform an SCM data structuregeneration process for the caller. In an example, the informationavailable in data stores of the platform comprises ratings of the callermade by participants of the SCM platform. Once an SCM data structure forthe unknown caller is created, it may be associated with the caller sothat future calls from the caller may facilitate accessing the generatedSCM data structure. In embodiments, rather than sending the existingcaller ID information to a recipient device, the generated first SCMdata structure may be provided to the call-receiving device using, forexample, one or more of the visual caller ID delivery methods describedherein. This may be accomplished by replacing an existing caller IDinformation, if any, with a link to the generated first SCM datastructure. As a way for enabling the recipient of a call from an unknowncaller to take advantage of the information gathered and evaluationsmade by other platform participants, a generated SCM data structure forthe caller may be provided to an SCM platform application executing onthe call receiving device contemporaneously with the incoming call.

A portion of the second SCM data structure delivered to the calloriginating device may be delivered as a ring-back tone, as an SMSmessage, as an MMS message, and an iMessage, as a traditional voicemail,as visual voicemail, and the like. In embodiments, the content deliveredto the caller's call originating device may include an offer and/orinstructions to join the SCM data structure platform, such as tofacilitate easier access to platform participants, and the like.

Referring to FIG. 45, a flowchart of a method for unknown caller IDvisual caller ID generation and feedback aggregation. In embodiments,visual caller ID, optionally embodied as a portion of an SCM datastructure may be generated for unknown callers using the flow 4500. Anindication of a call from an unknown caller is detected and/or receivedat step 4502. The indication is provided to a content gathering functionat step 4506 that uses caller ID 4504 for the call to find and gatherinformation about the caller from external (e.g., the Internet) andinternal (e.g., internal SCM platform resources). The gatheredinformation may next be used in step 4508 to generate an SCM datastructure for the caller 4510. The SCM data structure for the caller4510 may be provided to an SCM platform communication function that mayperform a step 4512 of delivering the SCM data structure to a recipientdevice, such as an item of visual caller ID that the recipient mayaccept, reject, or provide feedback on, such as whether or not thevisual caller ID is helpful and the like. The SCM data structure orportions thereof, such as an item of visual content may optionally beprovided to the caller. Content provided to the caller may be adapted toinform the caller of the presence of an SCM data structure platformoperating on behalf of the recipient to screen/augment caller IDinformation, an invitation to join the platform, and the like. At step4514 the feedback from the caller, recipient, or both may be aggregatedand saved in a data structure 4516 that may be accessible to theplatform as an internal platform resource and the like.

In embodiments, an after-call experience for recipients of calls mayinclude the platform taking actions to communicate with the recipientafter receipt or completion of a phone call. For calls with a business,the platform can coordinate presentation of content to a callparticipant (typically a consumer), such as from third-partyadvertisers, retailers and other partners to deliver coupons, textalerts, reviews, and other retail-based enticements to further continuewith a relationship initiated or a prior relationship continued duringthe call. Other examples of post-call experience may include theplatform pairing with partners that want to learn more from callerparticipants, such as follow-up comments, reviews, debrief efforts, etc.The methods and systems described herein for post call experience mayfacilitate a range of content delivery and interaction, both direct andreal-time (e.g., by presenting interactive content in a user interfaceof a phone of the call participant) and indirect (e.g., texting, email,and the like).

In embodiments, methods and systems of post-call experience may includeusing a call-in-process screen to present auto-generated interactivecontent, such as by use of the SCM data structure methods and systemsdescribed herein, optionally interfacing a phone call in/out applicationor function with an SCM data structure platform recipient/callerapplication. Post call experience methods and systems that interfacewith existing phone call applications may provide post call (and/oractive call) experienced by, for example configuring a sender-controlledmedia (SCM) application to receive SCM data-structures from senderparticipants of an SCM platform. In examples, a sender participant maybe any user of the platform, but may preferentially be a party that isinterested in gathering further input and/or establishing/continuing arelationship between a sender/caller and a recipient established orreferenced in a call. With an SCM data structure application configured,the post-call experience may be activated by interfacing the SCMapplication with a phone screen control portion of a phone applicationso that content in the received SCM data structure is provided to thephone application as content to be presented on an electronic display ofthe phone while the phone call is in progress. Essentially the effect ofthis to a user is content (e.g., images, text, video, moving content,and the like) may be presented in an in-process call screen on the callparticipant's smartphone, and the like. Feedback and/or input from acall participant on whose screen the content is displayed may becaptured by monitoring, such as with the SCM application, user actionsin association with the electronic display (e.g., user clicks, swipes,scrolls, dismissal actions, or simply no action at all) while content ispresented during or after the call. To the extent that the user actionsmay impact what is being presented, there may be a need for updating theSCM data structure for affecting the electronic display responsive tothe monitored user actions (such as changing to a “thank you” screen,and the like). Interfacing an SCM data structure application with aphone application may be directed at a phone screen control portion ofthe phone application. In embodiments, the SCM data structureapplication, or at least a portion useful for post-call call-participantinteraction, may have the phone screen control portion of the phoneapplication integrated into it. In embodiments, the SCM data structureapplication, or at least a portion useful for post-call call-participantinteraction may be integrated into the phone application. Such a portionmay include functionality for receiving and processing SCM datastructures. Other forms of interfacing an SCM data structure applicationwith a phone application may include, without limitation configuring areal-time channel of communication between the SCM application and thephone application through which SCM content is provided to the phoneapplication and user actions with the phone screen are provided to theSCM application.

Referring to FIG. 46 user screens for post call experience methods andsystems are presented. An incoming call may include calleridentification features, such as those exemplarily presented in thescreen 4602 in which a vendor, Credit Services Corporation (CSC) isplacing a call to a recipient. The caller identification features may bepresented in association with the methods and systems of visual callerID presented herein as well as in association with the methods andsystems of source-controlled media data structure operation describedherein. Upon indication that, for example, a call between CSC and therecipient has ended, but optionally before the phone is returned to itsmode of operation prior to the call, a post call experience screen 4604may be presented to, among other things, gather feedback about the call,such as about the recipient's call with the CSC representative. Inembodiments, the context from the caller identification screen, such asthe name of the representative may be used in the post-call experiencescreen to more effectively personalize the post call experience. Aportion of the post call experience screen 4604 may include a ratingoption 4606 for the call, an option to provide more feedback 4608, andan option to end the post call experience 4610, such as withoutproviding feedback.

In embodiments, post-call experience may include determining and/orusing an intent or understanding of in-process call content, such as aconversation between call participants using, for example, audio naturallanguage processing, audio-to-text and text natural language processing,machine learning, artificial intelligence and the like to generatecontent, optionally content in an SCM data structure, that iscontextually relevant to the call content and presenting the generated(SCM data structure-optional) content to at least one of the callparticipants, such as an originator of the call (e.g., a caller) and acall receiver (e.g., a recipient). Call intent-based post callexperience may be affected by a process that includes gathering callcontext for an active call between a caller and a recipient anddeveloping an understanding (e.g., during or after completion of thecall) of the call that may include at least one of a call intent, a callparticipant, and a call-related action (e.g., an action of or associatedwith a call participant) based on content exchanged between the callerand recipient and optionally context of the call (e.g., time of call andthe like). This understanding may be utilized by content suggestingalgorithms that determine candidate items of content (e.g., a video,image, photo from a gallery, and the like) that are relevant to at leastone of the participants of the call based on the applicability of thecontent items to the understanding. Content suggesting algorithms,methods and systems that may be applied in examples are describedelsewhere herein. With the suggested content in hand, a next step may beto present at least one of the candidate items of content to at leastone of the caller and the recipient during (or after) the call in anelectronic interface of a device in use during the call. In examples,discussion during a call may be about a product. An understandingdeveloped from the call may be that a first participant uses the productand the second does not. Content suggested may include images from thefirst participant's social media posting of the first participant usingthe product. This image may be presented to the first participant forapproval of sharing it with the second participant. Based on feedbackfrom the first participant, the content may be configured into an SCMdata structure that is delivered to and SCM data structure applicationof the second participant's phone. The delivered SCM data structure mayactivate the SCM application on the second participant's phone topresent, optionally through a screen control portion of a phoneapplication, the item of content approved by the first participant.Therefore, in embodiments, the electronic interface of the device isadapted to facilitate selection by a first call participant of one ofthe presented items of content for sharing with a second callparticipant.

In embodiments, understanding of call content may be based on naturallanguage processing of call audio and/or of a transcript of the callaudio, such as a real-time transcript stream, and the like.

In embodiments, call context may optionally be used to enrich an in-calland/or a post call experience. Call context may also be a form ofmachine-based understanding, such as an understanding of at least oneprior call between the caller and the recipient, an understanding of atleast one other call made by the caller, and an understanding of atleast one other call received by the recipient. Other ways in whichother calls of the participants may impact post call experience mayinclude using call context gathered from at least one prior call betweenthe caller and the recipient. The call context may be related to a callparticipant's use of an SCM data structure platform, such as the contextmay include sender-controlled media communicated to the recipientcontemporaneously with the call, a sender-controlled media platformprofile of the caller, a sender-controlled media platform profile of therecipient, and the like.

In embodiments, providing in-call or post-call experience may includeconfiguring a smartphone application that overtakes control of acall-in-process screen. Control of the screen may be taken during thecall connection, upon detection of termination of the call, prior toreleasing the phone function of the phone, and the like. Such in- orpost-call processing may include monitoring call in-process status of acall-participant device, such as a smartphone. Upon detection ofcall-in-process status indicating, for example, that a call in processhas terminated, activating a post-call application of the device, theactivating causing a screen update of the device. In embodiments, thescreen update could include any content but may preferably include acall to action by the call-participant or informational contentpertinent to the call. The call in-process status may indicate insteadthat control of the phone screen is permitted, such as after an initialperiod of time while the recipient accepts the call. Example of a callto action may include at least one selectable element presented in thescreen that when selected by the call-participant causes an update of adatabase associated with the call to action based on the at least oneselectable element that is selected. As an example, a call to actionmight be to agree to terms of business between the call participants orto disagree. Based on the call participant's acceptance or rejection ofthe terms, the database would be updated differently. In embodiments,activating a post-call application may cause a call function of thephone that was active during the call to remain active (essentially holdthe phone call function from allowing another call to be initiated orreceived) until either the screen update is acknowledged by thecall-participant (e.g., by the call participant selecting an element inthe updated screen), a screen update timer expires, and the userdismisses the updated screen. In embodiments, a screen update may beacknowledged by the call participant when the call participant selects aselectable element presented in the screen update or the callparticipant dismisses the screen update. The post call screen updateapplication may continue to present the updated screen until the screenupdate is acknowledged by the call-participant or a screen update timerexpires.

In embodiments, methods and systems for effecting a post-call experiencemay include signaling to a post-call application to take control of theuser interface screen of a phone upon detection of an indication of acall ending. The indication may be based on the content of the call(e.g., words spoken during the call) or based on a connection status(e.g., the call network signaling that the connection over which thecall was being made has been terminated). An exemplary method thereofmay include responsive to receiving an indication that a call in processis ending, activating a post-call application of a call-participantdevice, which causes a screen update of the device that includes contentrelevant to the callers or a content of the call and may include a callto action, information and the like. The indication received about thecall in process status that indicates an ending is based on theconnection status as noted above. however, the indication may beprovided by a call function of the device, such as when a user of thedevice touches the “end” function. However, as noted above, anindication that a post call experience may be activated may be based onthe content of the call. In embodiments, the content of the call may beprocessed with speech analysis of the audio in near-real time as it isbeing spoken, such as by detecting a call ending word, such as “goodbye”and the like. Other forms of call content analysis may be employed,including natural language understanding and the like that may indicatethat a call is coming to an end, or at least a conversation on the callis winding down.

In embodiments, the content provided by the post-call application mayinclude a call to action. Exemplary calls to action may include an offerfor a product or service to the call-participant, asking thecall-participant their review of the call, soliciting comments about thecall, capturing call-participant feedback on one of thecall-participants regarding a spammer status of the other of thecall-participants, collecting call-participant feedback on an SCM datastructure or more likely its content related to the call (e.g., visualcaller ID and the like) and the like.

In embodiments, a post call application may update a screen to includecontent from a sender-control media (SCM) data structure for anoriginator of the call that is automatically generated based on the callin process. The update and/or call to action may facilitate collectingcall-participant feedback on the automatically generated SCM datastructure content. In embodiments, another type of feedback that may becollected through a post call experience may include feedback regardingan originator of the call, a good or service referenced during the call,and the like. When one or more of the call participants utilizes SCMdata structure methods and systems described herein, the screen updatemay include visual content provided by one of the call-participants,such as from a sender-controlled media (SCM) data structure associatedwith one of the call-participants.

In embodiments, methods and systems of call-community influenced callerhandling may facilitate protecting recipients of the call community whenreceiving phone calls from users outside the platform. A form ofcall/contact firewall may be configured based on the confidence of otherusers completing phone calls or other communication on the platform toassess whether the unknown caller (unknown message sender) is spam, “badbusinesses,” other a caller to avoid. In examples, call communitymembers can provide reviews and contribute to confidence intervals of a“safe” caller that can be determined from those reviews and metricsbased on “successful” calls relative to spam calls.

Referring to FIG. 47, a block diagram of call community firewallconfiguration and a flow charge of a process for handling calls by thefirewall are depicted. A call community firewall process may includedetecting an incoming call at step 4702. Such an incoming call 4712 maybe caused by a call from an outside caller 4710, such as caller who isnot part of the community. The community firewall 4714 may act as aproxy or filter for such incoming calls 4712 for at least a portion ofthe members of the community 4718. Caller ID information for the caller4710 may be used to identify one or more entries in a community firewalldatabase 4716 at step 4704. Based on the information contained in thedatabase 4716, such as input from community members 4720 regarding thecaller and/or the member's preferences regarding the firewall operationon behalf of the member(s), at least one call impacting action may bedetermined at step 4706. Performing call impacting actions at step 4708may include, for example allowing the call to be passed along to therecipient, augmenting the call with visual caller ID information,providing a SCM data structure for the caller to the recipient's phone,terminating the call, providing an item of content back to the caller(e.g., a voice response), and many other such call impacting actions.

In embodiments, a call/message/contact firewall may activate firewallaction(s) on calls destined for or received at a recipient phone of aparticipant of the firewall. The firewall action(s) may be based oncaller ID-based criteria derived from firewall participantexperience/feedback with the caller. In embodiments, a call communitycontact firewall may include a caller ID capture function that retrievescaller ID data (e.g., provided by a call network) for a call (e.g.,being placed over the call network) to a recipient who is a member ofthe call community. The firewall may include a caller ID lookup functionthat retrieves firewall status from a firewall status database linkedthrough the retrieved caller ID data (e.g., a phone number of thecaller). The firewall status database links caller ID data with callcommunity ratings of the caller (e.g., of prior calls associated withthe caller ID data) that were received by members of the call community.A firewall action function then performs at least one call impactingaction based on the retrieved firewalls status. In embodiments, callimpacting actions may include terminating the call, connecting the callto the recipient, redirecting the call to voicemail, redirecting thecall to an automated response system.

In embodiments, call impacting actions may include providing call-actionrecommendations to the recipient and based on the recipient's responsethereto taking at least one other call impacting action. Actions thatmay be taken by or as a result of activating the firewall actionfunction may include generating a multi-media profile based on thecaller ID data and delivering that to the recipient. The multi-mediaprofile may be configured into a sender controlled media (SCM) datastructure. In embodiments, delivering this form of profiler may includecommunicating about the profile with an SCM interface function of acall-receiving device of the participant. In embodiments, a multi-mediaform of the profile may be delivered via a multimedia messaging service(MMS). A caller in this scenario may also be contacted. As an example, amulti-media profile based on the caller ID data may be generated anddelivered to a phone number indicated in the caller ID of the call as amultimedia messaging service (MMS) message. Another type of content thatcan be provided to the caller may include an audio message that can beplayed for the originator of the call in lieu of placing the call to therecipient. Call actions may further include redirecting the call to aquarantine module, redirecting the call to law enforcement, and thelike. In embodiments, the multi-media profile may be configured into asender controlled media (SCM) data structure but may be accomplished(wholly or partially) with a third-party web application through the SCMthat can be created and uploaded through a webapp, applicationprogramming interfaces, other links, and the like. By way of theseexamples, the SCM data structure can be created in and delivered from athird-party portal or a system outside of the platform but then importedinto the platform for use as the SCM data structure. In embodiments, abusiness with many locations and even those still with landlines canestablish the SCM data structure to extend an associated multi-mediaprofile during calls or messages to users on the platform. In doing so,a single number may be used for outreach as the caller ID number whilemore geographically-specific call back numbers can be provided duringthe call or during post-call experiences and follow-up. In examples, abarbershop with many locations can establish content for the SCM datastructure to extend a barbershop related multi-media profile duringcalls or messages to users on the platform. In embodiments, in call orin message experience can include linking to local barbershops andoffering coupons to barbershop locations that are close to each calleror message recipient in the group call and/or message from thebarbershop. In embodiments, post-call or post-message experience canalso be used to link to local barbershops and other entities to offercoupons, feedback and various post call or post message offerings.

In embodiments, building a contact firewall action set, which may be adata structure, for a caller and/or for protecting one or morerecipients may be based on call-community (e.g., SCM platformparticipant) experience with the caller. Third-party provided and/orpublicly accessible information about a sender/caller may also be usedin constructing the call-community firewall. A contact firewall forprotecting participants of a sender-controlled media (SCM) platform maybe generated when a call is received by a participant or when anindication that a sender who is not a participant in a sender-controlledmedia (SCM) platform has initiated contact with a recipient who is aparticipant of a sender-controlled media (SCM) platform. Senderinformation associated with the contact instance (e.g., caller ID,source IP address, recorded name and the like) may be used to poleparticipants of the platform regarding a spammer status value for thesender, essentially asking the participants if they think the caller isworth passing through to the recipient. In embodiments, the informationand poll results may be aggregated across many calls by the caller tomembers of the platform. The aggregated information may be processed(e.g., summed, averaged, or otherwise analyzed and may produce a spammervalue that can be compared to a spammer threshold. If the threshold isexceeded or the aggregation of poll results otherwise indicates that thecaller should be blocked, future contacts from the sender can berejected by the platform so that the sender is blocked from contactingparticipants of the platform. Such a firewall may be for phone calls,emails, text messages, and any other form of electronic contact. Inembodiments, such a firewall may be applied to services that receive andscan hard copy mailings that are then delivered as an electronic contact(e.g., as a daily or weekly email and the like).

In embodiments, a contact firewall for protecting participants of a callgroup may be generated when a call is received by a member or when anindication that a sender who is not a member has initiated contact witha recipient who is a member. Sender information associated with thecontact instance (e.g., caller ID, source IP address, recorded name andthe like) may be used to poll members regarding a spammer status valuefor the sender, essentially asking the members if they think the calleris worth passing through to the recipient. The information and pollresults may be aggregated across many calls by the caller to members.The aggregated information may be processed (e.g., summed, averaged, orotherwise analyzed and may produce a spammer value that can be comparedto a spammer threshold. If the threshold is exceeded or the aggregationof poll results otherwise indicates that the caller should be blocked,future contacts from the sender can be rejected so that the sender isblocked from contacting the members. Such a firewall may be for phonecalls, emails, text messages, and any other form of electronic contact.In embodiments, such a firewall may be applied to services that receiveand scan hard copy mailings that are then delivered as an electroniccontact (e.g., as a daily or weekly email and the like) to members ofthe call group.

As noted herein, a contact firewall may take a contact impacting actionincluding terminating the contact, forwarding the contact to theparticipant, offering the participant the option of accepting thecontact, redirecting the contact to an automated response system,redirecting the contact to an off-line message service, such as voicemail or facilitating the sender to leave a text, image, or video messageand the like. The firewall may provide additional control to therecipient by providing call-action recommendations to the recipient andbased on the recipient's response thereto taking a call impactingaction.

In embodiments, actions that may be taken by or as a result ofactivating the firewall action function may include generating amulti-media profile based on the caller ID data and delivering that tothe recipient. The multi-media profile may be configured into a sendercontrolled media (SCM) data structure. Delivering this form of profilermay include communicating about the profile with an SCM interfacefunction of a call-receiving device of the participant. In embodiments,a multi-media form of the profile may be delivered via a multimediamessaging service (MMS). A caller in this scenario may also becontacted. As an example, a multi-media profile based on the caller IDdata may be generated and delivered to a phone number indicated in thecaller ID of the call as a multimedia messaging service (MMS) message.In embodiments, another type of content that can be provided to thecaller may include an audio message that can be played for theoriginator of the call in lieu of placing the call to the recipient.Call actions may further include redirecting the call to a quarantinemodule, redirecting the call to law enforcement, and the like. Inembodiments, an action by the firewall may include delivering an audiomessage to an originator of the call. Such an action may be performed inlieu of placing the call to the recipient.

In embodiments, call community firewall methods and systems may includegathering call originator feedback from members of the community foreach call originator originating a call to members of the community. Thecall community firewall methods may further include storing the feedbackfrom the members in a contact firewall data structure indexed by calloriginator identification information, such as caller ID and the like.Also, a contact firewall function may be configured that intercepts acall to a member of the group while determining if the feedback in thecontact firewall data structure for an originator of the call indicatesthat an action to impact the call should be taken.

In embodiments, the firewall may operate on calls routed through a VoIPchannel and the firewall may be processed on a cloud server. The cloudserver may be acting as a call-receiving proxy for the recipients.

In embodiments, sender-controlled media (SCM) platform methods andsystems may facilitate authentication of participants in a contactinstance (e.g., a phone call, customer service text exchange, and thelike). In embodiments, a retailer or other third-parties may rely on theplatform to communicate and/or authenticate its users. In examples, acredit card provider, such as American Express can use the platformmethods and systems to develop its own SCM data structure that may becommunicated to customers engaged with an electronic exchange/contactinstance to facilitate trusting the parties. In examples, customersusing SCM data structure applications and the like on a digital device,such as a mobile phone can interact with the SCM data structure contentpresented as a technique for establishing a form of authentication. Inexamples, the SCM data structure can include information about theparticipants, including information that may only be known to theparticipants, such as an authentication key, a picture, a picture of aface, a quiz to establish indemnity, choice of spelling for difficultnames, and other media with which interaction can be used toauthenticate the user, the retailer, and/or the communication channel.In examples, when a retailer/credit card provider's agent is workingwith a client (e.g., via phone, text, etc.), the agent can verifyidentity, name, address or other information by displaying contentvisually on the client's screen, such as on a locked screen of theclient device, optionally using SCM data structure rendering functionsdescribed herein. The agent can use this interface to show relevanttutorials, videos photos or other media to enhance the conversation orcustomer support experience.

Referring to FIG. 48, a call participant authentication screens that usethe SCM data structure methods and systems for providing content to arecipient of a call contemporaneously with a call and other such methodsas described herein are depicted. In embodiments, an incoming call froma business may include a call participant verification screen 4802 thatmay further include an interactive item of content 4804 to facilitate atleast partial verification of a recipient of the call. Upon selection ofa valid response in the interactive item of content 4804, a secondcaller identification screen 4806 may be presented to the recipient withthe option to talk with the caller 4808.

In embodiments, an authentication system may use user-generated SCM datastructure content to authenticate the user for current or futureactions. Such an authentication system may affect user authentication byaccessing with a processor an instance of a sender-controlled media(SCM) data structure, the structure optionally is secured with encodingand other techniques, of a first contact participant in a digitalcontact/exchange between the first contact participant and a secondcontact participant. In examples, a user contacting a vendor may havecreated an SCM data structure that contains information useful for thevendor authenticating the user such as a password and the like that aperson using the user's phone might not know. The exchange may requirethe user providing a response to SCM data structure content presented inthe user interface portion of the digital exchange. Based on theresponse, real-time content captured through the interface may be usedto update the context of the digital exchange (e.g., a real-timecaptured image of the phone user's face). In embodiments, algorithms mayprocess the updated digital exchange context in an attempt to validatethe first contact participant by, for example comparing the real-timecontent with another portion of the secure SCM data structure. Inexamples, the real-time captured image of the phone user's face may bematched to a stored image of the validated user's face. Thus, based on aresult of the validating, sending a digital signal to the second contactparticipant that the first contact participant is or is not anauthenticated participant. In examples, the content exchange may occurvia SCM data structure applications or functions operating on one orboth of the user's phone (or computer, laptop, tablet and the like) andthe other participants computing system. Optionally algorithms forsecurely managing access to SCM data structure content for theparticipants may be executing on a third server that controls access toSCM data structures.

In embodiments, the real-time content is an image captured through acamera interface of the digital device; the image may be a face of auser proximal to the digital device. In embodiments, the real-timecontent may include audio captured through a microphone interface of thedigital device that may produce an audio recording of a user proximal tothe digital device. Further, the audio may be a voice recording of aword spoken into the microphone of the digital device. Validation may bebased on a comparison of the spoken word with a copy of that spoken wordidentified in the SCM data structure. The validation may be based oncomparing audio files, transcripts of audio files, and a combinationthereof. Alternatives for real-time captured content may include abiometric indicator captured through a biometric interface of thedigital device, such as a fingerprint, retinal scan, multi-biometricfactor metric and the like.

In embodiments, after receiving no answer to a text message or a phonecall, a user can generate and submit to the platform for delivering avideo follow-up, such as a video message. The video message may bedelivered instead of just a voicemail or text message. In examples, thefollow-up may be configured as content in an SCM data structure and canbe a video “voicemail,” follow up details (e.g., notes of the call,transcript of the call, URL, document link and the like), locationinformation, call history, etc. Delivery of the follow-up content may beperformed through the SCM platform methods and system described hereinor through a third-party communication channel.

Referring to FIG. 49, screens for producing and viewing visual/videovoice mail are depicted. In response to a recipient not answering acall, visual voicemail screen 4902 may be presented to the caller on thecaller's call originating device screen. The screen 4902 may includeoptions for recording a voice mail, recording a video, capturing a newimage, selecting an existing image, typing a text message, andcombinations thereof as well as ending the call without leaving anymessage. In embodiments, the recorded video may be communicated to thevoice mail handling function of the recipient, such as a voice mailsystem that supports playback of audio recordings left by callers. Inembodiments, the recorded video may be accessible via an SCM datastructure that was created or modified based on the recorded video. Alink to a corresponding SCM data structure may be forwarded to therecipient in addition to or in lieu of an audio message. When a callmessage handling function of the recipient encounters an indication ofan SCM data structure being left by the caller, an SCM data structurehandling application, a portion of which may execute on the recipient'sphone, thereby causing the caller's visual/video message to be playedback on the recipient's phone. Such playback is depicted in the videovoicemail playback screen 4904.

In embodiments, upon receiving an indication of no-answer by a recipientof a phone call placed from a caller who may be a participant in an SCMdata structure platform, a portion of platform, such as a call interfaceof the caller's phone, may activate an SCM data structure contentselection/generation interface on the caller's phone through which thecaller can cause to be generated content for use in a follow-up messageto the recipient. The generated content may then be delivered to therecipient's phone and/or to the recipient's message storage queue (e.g.,voice mail queue). Upon retrieval from the phone message storage queue,an SCM data structure platform interface executing on the recipient'sphone, optionally in cooperation with a companion function executing ona server, presents/plays back the content through the user interface ofan electronic device through which the recipient accessed the phonemessage storage queue.

No-answer methods and systems for generating a video message may includereceiving an indication of no-answer by a recipient of a call placedfrom a caller to the recipient. Responsive to that indication, asender-controlled media (SCM) content selection/generation interface maybe activated on the caller's phone so that the caller can generate anitem of content, such as a video recording that can then be delivered tothe recipient. In embodiments, the SCM content selection/generationinterface facilitates capturing content with a camera function of thecaller's phone. The content may include at least one of a still imageand a video. In embodiments, the generated item of content is an imagecaptured by a camera function of the caller's phone during use of theSCM content selection/generation interface.

In embodiments, producing video content to a caller responsive to thecaller receiving an indication of no-answer by a recipient of a call mayinclude activating a sender-controlled media (SCM) contentselection/generation interface on the caller's phone through which iscaused to be generated an SCM data structure comprising an item ofcontent selected by the caller. Delivering the generated item of contentmay include delivering at least one of a link to the SCM data structureand the SCM data structure to the recipient's call message storagesystem, wherein the SCM data structure is linked to the missed call.When the recipient retrieves the stored item of content, such as byretrieving a link to an SCM data structure referencing the item ofcontent, an SCM data structure rendering function of a phone of therecipient may render the content indicated in the retrieval on a displayscreen of the recipient phone or through any electronic device throughwhich the retrieval is performed. Therefore, a user may retrieve hisphone messages with a tablet and can see the video message left by thecaller.

In embodiments, standard functions, such as voice mail access functionsmay work cooperatively with video message generation and deliveryfunctions so that a call message access function executing on acomputing device (e.g., voice mail menu in a phone app) causes(optionally automatically) activation of an SCM content playbackfunction thereby rendering the content referenced in the voice mailaccess retrieval. The SCM content playback function and/or the voicemail access function may access a portion of the SCM data structurecontent from a networked server.

The generated content may exemplarily include a video captured by thecaller through the SCM content selection/generation interface, alocation of the caller, a location related to the recipient, an existingSCM data structure of the caller (e.g., a caller SCM data structureprofile and the like).

In embodiments, methods and systems of no answer handling may include areplacement for or companion to visual voice mail that determines atleast an intent, an object, and an action of a voice mail message anduses the determined information to generate an SCM-based data structureof audio, text, and image-based content, a link to which is stored inthe recipient's voice mail queue and may be linked to or used in placeof a corresponding voice mail message. Accessing the link with arecipient's voice mail handler app may cause the handler app to activatean SCM platform user interface that takes control of the recipient'sphone to present at least one of visual and audio content of theSCM-based data structure.

In embodiments, a method for automatically generating visual contentfrom a voice mail recording may include processing a voice mailrecording or transcription thereof with machine learning functionsresponsive to receiving an indication of the voice mail being recorded.The understanding of the new voice mail by may be accomplished byapplying at least one of machine learning and natural languageprocessing to the new voice mail. A visual content selection functionmay select an item of visual content that is consistent with theunderstanding and link it to an SCM data structure that facilitatesprogrammatically linking the voice mail to the item of visual content.

In embodiments, a real-time method for automatically generating visualcontent from a voice mail may include developing an understanding ofaudio content of a voice mail message being played back on a computingdevice by applying at least one of machine learning and natural languageprocessing to the playback. Based on the developed understanding,operating a content selection function that facilitates selecting atleast one item of visual content that is consistent with theunderstanding. The visual item of content may then be presented on adisplay screen of the computing device contemporaneously with theplayback. Therefore, while a user is listening to a voice mail message,a visual item of content, such as an image, a video, a photo selectedfrom a user's photo gallery, visual content from the Internet, and awide range of other sources may be automatically matched to anunderstanding of the message. In embodiments, the understanding of theaudio content may be determined to be an intent of the call, an objectof the call, and an action associated with at least one of a callerleaving the message and an intended recipient of the message, and thelike. The understanding may be an intent that is based on an intendedrecipient of the message; it may also be an intent based on arelationship of the intended recipient to a caller leaving the message.In embodiments, selecting is performed by a visual content selectionalgorithm that performs a best fit of a visual content item to theunderstanding.

The methods and systems of the present disclosure include receiving anindication of an initiation of a call from a sender to a recipient;determining an SCM data structure for use in configuring visual callerID for the call based on a selection of a visual content item by anoriginator of the call; referencing an SCM participant database with anidentifier of the recipient; generating an adapted SCM data structure byadapting a portion of the SCM data structure based on an item ofinformation referenced in the SCM participant database with therecipient identifier; and configuring caller ID for the call with a linkto the adapted SCM data structure.

In the methods and systems, the selection of a visual content itemoccurs in a visual caller ID selection interface that when executed on acall-originating device causes, responsive to a user of thecall-originating device initiating a call, options for content for avisual caller ID to be presented in the visual caller ID selectioninterface.

In the methods and systems, the selection of a visual content itemoccurs in a visual caller ID selection interface that when executed on acall-originating device causes options for content for visual caller IDto be presented in the visual caller ID selection interface.

In the methods and systems, at least one of the options for contentcomprises an image being provided by a camera of the call-originatingdevice

In the methods and systems, the visual caller ID selection interfaceaccesses a camera of the call-originating device and presents contentimaged by the camera as one of the options for content.

In the methods and systems, adapting a portion of the SCM data structurecomprises adapting a recipient name element of the data structure tocorrespond to a name of the recipient.

In the methods and systems, adapting a portion of the SCM data structurecomprises adapting a recipient group affiliation element of the datastructure to correspond to a group affiliation of the recipient.

In the methods and systems, adapting a portion of the SCM data structureis based on a recipient name.

In the methods and systems, adapting a portion of the SCM data structureis based on a group affiliation of the recipient.

In the methods and systems, adapting a portion of the SCM data structureis based on a name of a recipient referenced in the SCM participantdatabase corresponding to a list of exception names.

In the methods and systems, the item of information referenced in theSCM participant database determines a client-status message portion ofthe SCM data structure.

In the methods and systems, based on the item of information, theclient-status message portion is configured as one of an existing clientmessage, a referral client message, and a cold-call client message.

The methods and systems of the present disclosure include receiving anindication of an initiation of a call from a sender to a recipient;determining an amount of time left in an offer from the sender to therecipient; generating an SCM data structure by adapting a portion of theSCM data structure based the amount of time left; and configuring callerID for the call with a link to the generated SCM data structure.

In the methods and systems, the SCM data structure indicates an imagefor presentation on an electronic display of a call receiving deviceupon receipt of the call.

In the methods and systems, the image is an image captured by a camerafunction of a call-initiating device captured contemporaneously with theinitiation of the call.

In the methods and systems, the SCM data structure indicates a video forpresentation on an electronic display of a call receiving device uponreceipt of the call.

In the methods and systems, the SCM data structure indicates amulti-media object for presentation on an electronic display of a callreceiving device upon receipt of the call.

In the methods and systems, the SCM data structure comprises a profileof the caller.

In the methods and systems, the SCM data structure comprises promotionalcontent.

In the methods and systems, the linked SCM data structure comprises atleast one of an image and a video captured contemporaneously with theinitiating of the call.

The methods and systems of the present disclosure include receiving anindication of an initiation of a call from a sender to a recipient;determining call context comprising at least one of a day, date, andtime-of-day of the call; generating an SCM data structure by adapting aportion of the SCM data structure based the determined call context; andconfiguring caller ID for the call with a link to the generated SCM datastructure.

In the methods and systems, the SCM data structure indicates an imagefor presentation on an electronic display of a call receiving deviceupon receipt of the call.

In the methods and systems, the image is an image captured by a camerafunction of a call-initiating device captured contemporaneously with theinitiation of the call.

In the methods and systems, the SCM data structure indicates a video forpresentation on an electronic display of a call receiving device uponreceipt of the call.

In the methods and systems, the SCM data structure indicates amulti-media object for presentation on an electronic display of a callreceiving device upon receipt of the call.

In the methods and systems, the SCM data structure comprises a profileof the caller.

In the methods and systems, the SCM data structure comprises promotionalcontent.

In the methods and systems, the linked SCM data structure comprises atleast one of an image and a video captured contemporaneously with theinitiating of the call.

The methods and systems of the present disclosure include configuring,with a visual caller ID interface executing on a call-originatingdevice, visual caller ID for calls initiated by a user of thecall-originating device comprising a temporary item of visual content;and upon receiving an indication of an initiation of a call by the user,providing at least one of the temporary item of visual content and apermanent item of visual content as visual caller id to a recipient ofthe call based on a relationship between a current time and atime-limited use parameter of the temporary item of visual content.

In the methods and systems, configuring visual caller ID comprisesconfiguring an SCM data structure with at least one of a link to thetemporary item of visual content and the temporary item of visualcontent.

In the methods and systems, the relationship comprises a time remainingfor use of the temporary item of visual content.

In the methods and systems, the relationship comprises a use status ofthe temporary item of visual content.

In the methods and systems, the time-limited use parameter comprises anexpiration date for use of the temporary item of visual content.

In the methods and systems, the time-limited use parameter comprises ause start date and a use end date for use of the temporary item ofvisual content.

In the methods and systems, the time-limited use parameter comprises acalendar date, a pre-date duration of use prior to the calendar date anda post-date duration of use of the temporary item of visual contentafter the calendar date.

In the methods and systems, the time-limited use parameter comprises alink to an entry in a digital calendar of the user of thecall-originating device.

The methods and systems of the present disclosure include detectinginitiation of a first call from a first caller to a first recipient of arecipient call group, the call causing visual caller ID contentconfigured based on characteristics of the recipient call group to beaccessible by a call receiving device of the first recipientcontemporaneously with receipt of the first call by the call receivingdevice; and in response to detecting initiation of a second call fromthe first caller to a second recipient of the recipient call group,configuring visual caller ID content for the second call based on acomparison of a characteristic of the recipient group and acorresponding characteristic of the second recipient.

In the methods and systems, the visual caller ID content is madeaccessible to the call receiving device as a link to an SCMdata-structure that comprises at least one of the visual caller IDcontent and a link thereto.

In the methods and systems, the link to an SCM data-structure isprovided to the call receiving device as caller ID information.

In the methods and systems, the visual caller ID content is madeaccessible to the call receiving device as a link in an SCMdata-structure that is provided to the call receiving devicecontemporaneously with receipt of the first call.

In the methods and systems, the characteristic of the recipient group isa group affiliation identifier.

In the methods and systems, the corresponding characteristic of thesecond recipient is a status of group affiliation with the recipientgroup.

In the methods and systems, configuring visual caller ID content for thesecond recipient comprises adjusting at least one element of the visualcaller ID content configured that was based on the characteristics ofthe recipient group based on a result of the comparison.

In the methods and systems, the corresponding characteristicdistinguishes the second recipient from at least one other recipient inthe call group.

In the methods and systems, the characteristic of the recipient groupindicates business contacts and wherein the distinction indicateswhether the second recipient is an internal or external businesscontact.

In the methods and systems, the corresponding characteristic of thesecond recipient is a status of the second recipient with respect to anobject of the second call

In the methods and systems, causing visual caller ID content configuredbased on characteristics of the recipient call group is performed byselecting a first caller visual caller ID content and adapting the firstcaller visual caller ID content to reflect the characteristic of therecipient group.

In the methods and systems, configuring visual caller ID content for thesecond call is further based on at least one of an identifier of a useractuating the initiation of the first call, an objective of the call, atime of the call, and an aspect of a call-receiving device of therecipient.

In the methods and systems, configuring visual caller ID content isbased on a characteristic of the call receiving device selected from thelist of call receiving device characteristics consisting of devicestorage capacity, device screen size, device operating mode, andavailability of a sender-controlled media (SCM) application on the callreceiving device.

In the methods and systems, causing visual caller ID content to beaccessible to the call-receiving device comprises transporting at leastone of the visual caller ID content and a link thereto over ashort-message-service connection to the call-receiving device.

In the methods and systems, causing visual caller ID content to beaccessible to the call-receiving device comprises transporting at leastone of the visual caller ID content and a link thereto over an imessagechannel linking the first caller with the call-receiving device.

The methods and systems of the present disclosure include detectinginitiation of a call from a caller to a recipient, wherein the callcauses visual caller ID content to be accessible to a visual caller IDapplication executing on a call-receiving device of the recipient;pausing delivery of the call until a call delivery signal is detected;while pausing delivery of the call, presenting a visual caller IDconfiguration user interface on a call-originating device of the caller,the visual caller ID configuration user interface facilitating providingthe visual caller ID content for the call by enabling selection from aplurality of visual caller ID content options to the caller, wherein thevisual caller ID content options include: existing content, at least onealternate content, and generation of content via a camera function ofthe call originating device; and responsive to a user selection of oneof the visual caller ID content options, generating the call deliverysignal for delivery of the call.

In the methods and systems, the visual caller ID configuration userinterface uses audio/video recording capabilities of the caller's deviceto configure the visual caller ID content.

In the methods and systems, detecting initiation of the call isperformed by a caller ID interrupt function of the caller's device thatfurther causes the pausing of delivery.

The methods and systems of the present disclosure further comprising anoption in the interface for designating the selected visual caller ID tobe used for calls made to the recipient.

In the methods and systems, the interface presents an indication ofvisual caller ID content in a sender-controlled media data structure asthe existing content.

In the methods and systems, the existing visual caller ID content isrecipient-specific.

In the methods and systems, the existing visual caller ID SCM content isadapted on-the-fly for the recipient.

In the methods and systems, the existing visual caller ID content is oneof an emoji, a gif, and a sticker.

In the methods and systems, the existing visual caller ID content isdesignated for calls made by the caller to members of a group of whichthe recipient is a member.

In the methods and systems, the call includes multiple recipients andthe existing content is designated for a caller-group comprising themultiple recipients and the user selected option is used as visualcaller ID content for a subset of the recipients, wherein the subset ofrecipients is selected by the caller in the interface.

In the methods and systems, pausing the delivery of the call is based ona characteristic of the recipient.

In the methods and systems, the characteristic is a relationship betweenthe recipient and a group of recipients to whom the call is directed.

The methods and systems of the present disclosure include detectinginitiation of a call from a caller to a recipient, wherein the callcauses visual caller ID content to be accessible to a visual caller IDapplication executing on a call-receiving device of the recipient;pausing delivery of the call until a call delivery signal is detected;and while pausing delivery of the call, producing the visual caller IDcontent by a sequence of steps comprising: capturing live contentcomprising at least one of audio and text input to a call-originatingdevice by the caller; processing the captured live content to determinean intent of the live content; automatically selecting a visual elementbased on the intent, combining the selected visual element with the livecontent thereby producing the visual caller ID content: and generatingthe call delivery signal for delivery of the call.

In the methods and systems, processing comprises audio to textconversion of the captured live content.

In the methods and systems, processing comprises natural languageprocessing (NLP) of a least one of the captured text and the textconverted from the captured audio to determine the intent.

In the methods and systems, processing comprises natural languageprocessing (NLP) of a least one of the captured text and the textconverted from the captured audio to determine a subject of the call.

In the methods and systems, processing comprises natural languageprocessing (NLP) of a least one of the captured text and the textconverted from the captured audio to determine an action of the call.

In the methods and systems, automatically selecting is performed by avisual content selection algorithm that performs a best fit of a visualcontent item to the determined intent.

In the methods and systems, the determined intent is based on therecipient.

In the methods and systems, the determined intent is based on arelationship of the recipient to a group of recipients associated withthe call.

In the methods and systems, pausing the delivery of the call is based ona characteristic of the recipient.

In the methods and systems, the characteristic is a relationship betweenthe recipient and a group of recipients to whom the call is directed.

The methods and systems of the present disclosure include configuring asender-controlled media (SCM) data structure to include content selectedin response to an understanding of digital content captured by a calloriginating device, comprising: capturing content by the calloriginating device comprising at least one of audio, video and textinput to a call-originating device by the caller; processing thecaptured live content to determine an intent of the live contentautomatically selecting at least one visual element based on the intent;presenting the at least one visual element in an electronic userinterface of the call originating device; and based on a selection of atleast one of the at least one visual element combining the selectedvisual element with the live content thereby producing a caller story:and forwarding the caller story to a recipient.

An unknown caller method comprising: receiving an indication that acaller who is not a participant in a sender-controlled media (SCM)platform has initiated a call to a recipient who is a participant of asender-controlled media (SCM) platform; using caller ID information ofthe call to gather content pertaining to the caller from a plurality ofsources including information available in data stores of the platformand public number search information; generating a sender-controlledmedia (SCM) data structure based on the gathered content; delivering thegenerated SCM data structure to a call receiving device of therecipient; and presenting content from the generated SCM data structureto the recipient in a visual caller ID interface on the call-receivingdevice.

In the methods and systems, the information available in data stores ofthe platform comprises information collected regarding calls from thecaller placed to other participants of the SCM platform.

In the methods and systems, the information available in data stores ofthe platform comprises unverified information provided by platformsmembers about the caller.

In the methods and systems, the information available in data stores ofthe platform comprises ratings of the caller made by participants of theSCM platform.

In the methods and systems, the generated SCM data structure isassociated with the caller in the platform.

In the methods and systems, the generated SCM data structure is providedto the call-receiving device instead of the caller ID information.

In the methods and systems, caller ID information for the call isreplaced with a link to the generated SCM data structure.

In the methods and systems, the generated SCM data structure is providedto an SCM platform application executing on the call receiving devicecontemporaneously with the initiated call.

An unknown contactor method comprising: receiving an indication that asender who is not a participant in a sender-controlled media (SCM)platform has initiated contact with a recipient who is a participant ofa sender-controlled media (SCM) platform; using sender informationassociated with the contact instance to gather content pertaining to thesender from a plurality of sources including information available indata stores of the platform and public search sources; generating asender-controlled media (SCM) data structure based on the gatheredcontent; delivering the generated SCM data structure to acontact-receiving device of the recipient; and presenting content fromthe generated SCM data structure to the recipient in an SCM interface onthe contact-receiving device.

In the methods and systems, the information available in data stores ofthe platform comprises information collected regarding contact by thesender to other participants of the SCM platform.

In the methods and systems, the information available in data stores ofthe platform comprises unverified information provided by platformsmembers about the sender.

In the methods and systems, the information available in data stores ofthe platform comprises ratings of the sender made by participants of theSCM platform.

In the methods and systems, the generated SCM data structure isassociated with the sender in the platform.

In the methods and systems, the generated SCM data structure is providedto the call-receiving device.

In the methods and systems, the generated SCM data structure is providedto an SCM platform application executing on the contact receiving devicecontemporaneously with the initiated contact.

The methods and systems of the present disclosure include receiving anindication that a caller who is not a participant in a sender-controlledmedia (SCM) platform has initiated a call to a recipient who is aparticipant of a sender-controlled media (SCM) platform; using caller IDinformation of the call to gather content pertaining to the caller froma plurality of sources including information available in data stores ofthe platform and public number search information; generating asender-controlled media (SCM) data structure based on the gatheredcontent; and delivering a portion of the SCM data structure to a calloriginating device of the caller.

In the methods and systems, the portion of the SCM data structure isdelivered to the caller's call originating device as a ring-back tone.

In the methods and systems, the portion of the SCM data structure isdelivered to the caller's call originating device as an SMS message.

In the methods and systems, the portion of the SCM data structure isdelivered to the caller's call originating device as an MMS message.

In the methods and systems, the portion of the SCM data structure isdelivered to the caller's call originating device as an imessage.

In the methods and systems, the portion of the SCM data structure isdelivered to the caller's call originating device as visual voicemail.

In the methods and systems, the portion of the SCM data structure isdelivered to the caller's call originating device as a voicemail.

In the methods and systems, the portion of the SCM data structurecomprises an offer to join the platform.

The methods and systems of the present disclosure include receiving anindication that a caller who is not a participant in a sender-controlledmedia (SCM) platform has initiated a call to a recipient who is aparticipant of a sender-controlled media (SCM) platform; using caller IDinformation of the call to gather content pertaining to the caller froma plurality of sources including information available in data stores ofthe platform and public number search information; generating arecipient sender-controlled media (SCM) data structure based on thegathered content; delivering the generated recipient SCM data structureto a call receiving device of the recipient; presenting content from thegenerated recipient SCM data structure to the recipient in a visualcaller ID interface on the call-receiving device; generating a sender(SCM) data structure based on the gathered content; and delivering aportion of the sender SCM data structure to a call originating device ofthe caller.

In the methods and systems, the information available in data stores ofthe platform comprises information collected regarding calls from thecaller placed to other participants of the SCM platform.

In the methods and systems, the information available in data stores ofthe platform comprises unverified information provided by platformsmembers about the caller.

In the methods and systems, the information available in data stores ofthe platform comprises ratings of the caller made by participants of theSCM platform.

In the methods and systems, the generated recipient SCM data structureis associated with the caller in the platform.

In the methods and systems, the generated recipient SCM data structureis provided to the call-receiving device instead of the caller IDinformation.

In the methods and systems, caller ID information for the call isreplaced with a link to the generated recipient SCM data structure.

In the methods and systems, the generated recipient SCM data structureis provided to an SCM platform application executing on the callreceiving device contemporaneously with the initiated call.

In the methods and systems, the portion of the sender SCM data structureis delivered to the caller's call originating device as a ring-backtone.

In the methods and systems, the portion of the sender SCM data structureis delivered to the caller's call originating device as an SMS message.

In the methods and systems, the portion of the sender SCM data structureis delivered to the caller's call originating device as an MMS message.

In the methods and systems, the portion of the sender SCM data structureis delivered to the caller's call originating device as an imessage.

In the methods and systems, the portion of the sender SCM data structureis delivered to the caller's call originating device as visualvoicemail.

In the methods and systems, the portion of the sender SCM data structureis delivered to the caller's call originating device as a voicemail.

In the methods and systems, the portion of the sender SCM data structurecomprises an offer to join the platform.

The methods and systems of the present disclosure include configuring asender-controlled media (SCM) application to receive SCM data-structuresfrom sender participants of an SCM platform; interfacing the SCMapplication with a phone screen control portion of a phone applicationso that content in the received SCM data structure is provided to thephone application as content to be presented on an electronic display ofthe phone while the phone call is in progress; monitoring with the SCMapplication user actions in the electronic display while content ispresented during the call; and updating the SCM data structure foraffecting the electronic display responsive to the monitored useractions.

In the methods and systems, interfacing comprises integrating the phonescreen control portion of the phone application with the SCMapplication.

In the methods and systems, interfacing comprises integrating SCMapplication functionality for receiving and processing SCM datastructures into the phone application.

In the methods and systems, interfacing comprises configuring areal-time channel of communication between the SCM application and thephone application through which SCM content is provided to the phoneapplication and user actions with the phone screen are provided to theSCM application.

The methods and systems of the present disclosure include gathering callcontext for an active call between a caller and a recipient; developingan understanding during the call of at least one of a call intent, acall participant, and a participant action based on content exchangedbetween the caller and recipient and the call context; applying contentsuggesting algorithms that determine candidate items of content that arerelevant to at least one of the participants of the call based onapplicability of the content items to the understanding; and presentingat least one of the candidate items of content to at least one of thecaller and the recipient during the call in an electronic interface of adevice in use during the call.

In the methods and systems, the electronic interface of the device isadapted to facilitate selection by a first call participant of one ofthe presented items of content for sharing with a second callparticipant.

In the methods and systems, the understanding is based on naturallanguage processing of call audio.

In the methods and systems, the understanding is based on naturallanguage processing of a transcript of the call audio

In the methods and systems, the call context comprises an understandingof at least one prior call between the caller and the recipient.

In the methods and systems, the call context comprises an understandingof at least one other call made by the caller.

In the methods and systems, the call context comprises an understandingof at least one other call received by the recipient.

In the methods and systems, the call context comprises sender-controlledmedia communicated to the recipient contemporaneously with the call.

In the methods and systems, the call context comprises asender-controlled media platform profile of the caller.

In the methods and systems, the call context comprises asender-controlled media platform profile of the recipient.

In the methods and systems, the call context comprises call contextgathered from at least one prior call between the caller and therecipient.

The methods and systems of the present disclosure include monitoringcall-in process status of a call-participant device; and upon detectionof call-in-process status indicating that a call-in process hasterminated, activating a post-call application of the device, theactivating causing a screen update of the device that includes at leastone of a call to action by the call-participant and informationalcontent pertinent to the call.

In the methods and systems, the call to action comprises at least oneselectable element presented in the screen that when selected by thecall-participant causes an update of a database associated with the callto action based on the at least one selectable element that is selected.

In the methods and systems, activating further causes a call function ofthe phone that was active during the call to remain active until atleast one of the screen update is acknowledged by the call-participantand a screen update timer expires

In the methods and systems, the screen update continues until at leastone of the screen update is acknowledged by the call-participant and ascreen update timer expires

In the methods and systems, the screen update is acknowledged by thecall-participant comprises at least one of the user selecting aselectable element presented in the screen update and the user dismissesthe screen update.

The methods and systems of the present disclosure include activating apost-call application of a call-participant device responsive toreceiving an indication that a call-in process is ending. The activatingcauses a screen update of the device that includes at least one of acall to action by the call-participant and informational contentpertinent to the call.

In the methods and systems, the indication that a call-in process isending is connection-based.

In the methods and systems, the indication that a call-in process isending is provided by a call function of the device.

In the methods and systems, the indication that a call-in process isending is call content-based.

In the methods and systems, a call content-based indication of a call-inprocess ending is based on speech analysis of call audio.

In the methods and systems, speech analysis of call audio detects atleast one call ending keyword spoken by at least one of thecall-participants.

In the methods and systems, the call to action comprises an offer for aproduct or service to the call-participant.

In the methods and systems, the call to action comprises asking thecall-participant their review of the call.

In the methods and systems, the call to action comprises solicitingcomments about the call.

In the methods and systems, the call to action facilitates the captureof call-participant feedback on one of the call-participants regarding aspammer status of one of the call-participants.

In the methods and systems, the screen update comprises content from asender-control media (SCM) data structure for an originator of the callthat is automatically generated based on the call-in process.

In the methods and systems, the call to action of the screen updatefacilitates collecting call-participant feedback on the SCM datastructure content.

In the methods and systems, the screen update facilitates collectingcall-participant feedback regarding an originator of the call.

In the methods and systems, the screen update facilitates collectingcall-participant feedback on a good or service referenced during thecall.

In the methods and systems, the screen update comprises visual contentprovided by one of the call-participants.

In the methods and systems, the visual content is retrieved from asender-controlled media (SCM) data structure associated with one of thecall-participants.

The methods and systems of the present disclosure include a callcommunity contact firewall that includes a caller ID capture functionretrieving caller ID data provided by a call network for a call beingplaced over the call network to a recipient who is a member of the callcommunity; a caller ID lookup function retrieving firewall status from afirewall status database based on the retrieved caller ID data, thefirewall status database linking caller ID data with call communityratings of prior calls associated with the caller ID data that werereceived by members of the call community; and a firewall actionfunction that performs at least one call impacting action based on theretrieved firewalls status.

In the methods and systems, the at least one call impacting actioncomprises terminating the call.

In the methods and systems, the at least one call impacting actioncomprises connecting the call to the participant.

In the methods and systems, the at least one call impacting actioncomprises redirecting the call to voicemail

In the methods and systems, the at least one call impacting actioncomprises redirecting the call to an automated response system.

In the methods and systems, the at least one call impacting actioncomprises providing call-action recommendations to the recipient andbased on the recipient's response thereto taking at least one other callimpacting action.

In the methods and systems, the firewall action function furtherfacilitates generating a multi-media profile based on the caller ID dataand delivering that to the recipient.

In the methods and systems, the multi-media profile comprises a sendercontrolled media (SCM) data structure and delivering to the recipientscomprises communicating about the profile with an SCM interface functionof a call-receiving device of the participant.

In the methods and systems, the multi-media profile is delivered via amultimedia messaging service (MMS).

In the methods and systems, the firewall action function furtherfacilitates generating a multi-media profile based on the caller ID dataand delivering that to a phone number indicated in the caller ID of thecall as a multimedia messaging service (MMS) message.

In the methods and systems, the multi-media profile comprises a sendercontrolled media (SCM) data structure and delivering to the recipientscomprises communicating about the profile with an SCM interface functionof a call-receiving device of the participant.

In the methods and systems, the call impacting action comprisesdelivering an audio message to an originator of the call in lieu ofplacing the call to the recipient.

A method of generating a contact firewall for protecting participants ofa sender-controlled media (SCM) platform, the method comprising:receiving an indication that a sender who is not a participant in asender-controlled media (SCM) platform has initiated contact with arecipient who is a participant of a sender-controlled media (SCM)platform; using sender information associated with the contact instanceto pole participants of the platform regarding a spammer status valuefor the sender; aggregating the spammer status values received in thepole; and based on a comparison of the aggregated spammer status valueswith a spammer threshold, causing future contacts from the sender to berejected by the platform so that the sender is blocked from contactingparticipants of the platform.

A method of generating a contact firewall for protecting members of acall group, the method comprising: receiving an indication that a senderwho is not a member of the call group has initiated contact with arecipient who is a member of the call group; using sender informationassociated with the contact instance to pole members of the call groupregarding a spammer status value for the sender; aggregating the spammerstatus values received in the pole; and based on a comparison of theaggregated spammer status values with a spammer threshold, causingfuture contacts from the sender to be acted upon by the contact firewallto facilitate unwanted callers being blocked from contacting members ofthe call group.

In the methods and systems, the contact firewall acts upon contacts fromthe sender by taking at least one call impacting action.

In the methods and systems, the at least one call impacting actioncomprises terminating the call.

In the methods and systems, the at least one call impacting actioncomprises connecting the call to the participant.

In the methods and systems, the at least one call impacting actioncomprises redirecting the call to voicemail

In the methods and systems, the at least one call impacting actioncomprises redirecting the call to an automated response system.

In the methods and systems, the at least one call impacting actioncomprises providing call-action recommendations to the recipient andbased on the recipient's response thereto taking at least one other callimpacting action.

In the methods and systems, the at least one call impacting actionfurther facilitates generating a multi-media profile based on the callerID data and delivering that to the recipient.

In the methods and systems, the multi-media profile comprises a sendercontrolled media (SCM) data structure and delivering to the recipientscomprises communicating about the profile with an SCM interface functionof a call-receiving device of the participant.

In the methods and systems, the multi-media profile is delivered via amultimedia messaging service (MMS).

In the methods and systems, the at least one call impacting actionfurther facilitates generating a multi-media profile based on the callerID data and delivering that to a phone number indicated in the caller IDof the call as a multimedia messaging service (MMS) message.

In the methods and systems, the multi-media profile comprises a sendercontrolled media (SCM) data structure and delivering to the recipientscomprises communicating about the profile with an SCM interface functionof a call-receiving device of the participant.

In the methods and systems, the at least one call impacting actioncomprises delivering an audio message to an originator of the call inlieu of placing the call to the recipient.

The methods and systems of the present disclosure include for each calloriginator originating a call to members of a call group, gathering calloriginator feedback from the members; storing the feedback from themembers in a contact firewall data structure indexed by call originatoridentification information; and configuring a contact firewall functionthat intercepts a call to a member of the group while determining if thefeedback in the contact firewall data structure for an originator of thecall indicates that an action to impact the call should be taken.

In the methods and systems, call originator identification informationcomprises caller ID data;

In the methods and systems, the action to impact the call comprisesterminating the call.

In the methods and systems, the action to impact the call comprisesconnecting the call to the participant.

In the methods and systems, the action to impact the call comprisesredirecting the call to voicemail.

In the methods and systems, the action to impact the call comprisesredirecting the call to an automated response system.

In the methods and systems, the action to impact the call comprisesproviding call-action recommendations to the recipient and based on therecipient's response thereto taking at least one other call impactingaction.

In the methods and systems, the action to impact the call furtherfacilitates generating a multi-media profile based on the caller ID dataand delivering that to the recipient.

In the methods and systems, the multi-media profile comprises a sendercontrolled media (SCM) data structure and delivering to the recipientscomprises communicating about the profile with an SCM interface functionof a call-receiving device of the participant.

In the methods and systems, the multi-media profile is delivered via amultimedia messaging service (MMS).

In the methods and systems, the action to impact the call furtherfacilitates generating a multi-media profile based on the caller ID dataand delivering that to a phone number indicated in the caller ID of thecall as a multimedia messaging service (MMS) message.

In the methods and systems, the multi-media profile comprises a sendercontrolled media (SCM) data structure and delivering to the recipientscomprises communicating about the profile with an SCM interface functionof a call-receiving device of the participant.

In the methods and systems, the action to impact the call comprisesdelivering an audio message to an originator of the call in lieu ofplacing the call to the recipient.

The methods and systems of the present disclosure include accessing witha processor an instance of a secure sender-controlled media (SCM) datastructure of a first contact participant in a digital exchange betweenthe first contact participant and a second contact participant; updatingthe instance with real-time content captured through an interface of adigital device through which the first contact participant participatesin the digital exchange; validating with the processor the first contactparticipant by comparing the real-time content with another portion ofthe secure SCM data structure; and based on a result of the validating,sending a digital signal to the second contact participant that thefirst contact participant is an authenticated participant.

In the methods and systems, the real-time content comprises an imagecaptured through a camera interface of the digital device.

In the methods and systems, the image is a face of a user proximal tothe digital device.

In the methods and systems, the real-time content comprises audiocaptured through a microphone interface of the digital device.

In the methods and systems, the audio is a voice recording of a userproximal to the digital device.

In the methods and systems, the audio is of a voice recording of theword spoken by a user proximal to the digital device, the workidentified in the SCM data structure.

In the methods and systems, the real-time content comprises a biometricindicator captured through a biometric interface of the digital device.

In the methods and systems, the biometric indicator is a fingerprint.

The methods and systems of the present disclosure include receiving anindication of no-answer by a recipient of a call placed from a caller tothe recipient; in response to receiving the indication, activating asender-controlled media (SCM) content selection/generation interface onthe caller's phone through which is caused to be generated an item ofcontent; delivering the item of content to the recipient's call messagestorage system, wherein the item of content is linked to the missedcall.

In the methods and systems, the SCM content selection/generationinterface facilitates capturing content with a camera function of thecaller's phone, the content comprising at least one of a still image anda video.

In the methods and systems, the generated item of content is an imagecaptured by a camera function of the caller's phone during use of SCMcontent selection/generation interface.

In the methods and systems, causing an item of content to be generatedcomprises accessing a camera function of the caller's phone throughwhich at least one of an image and a video is captured as the item ofcontent.

The methods and systems of the present disclosure include receiving anindication of no-answer by a recipient of a call placed from a caller tothe recipient; in response to receiving the indication, activating asender-controlled media (SCM) content selection/generation interface onthe caller's phone through which is caused to be generated an SCM datastructure comprising an item of content selected by the caller;delivering at least one of a link to the SCM data structure and the SCMdata structure to the recipient's call message storage system, whereinthe SCM data structure is linked to the missed call.

In the methods and systems, the item of content comprises a videocaptured by the caller through the SCM content selection/generationinterface.

In the methods and systems, the item of content comprises a location.

In the methods and systems, the location is a location of the caller.

In the methods and systems, the location is a location to which therecipient is directed.

In the methods and systems, the item of content comprises an SCM datastructure of the caller.

The methods and systems of the present disclosure include receiving anindication of a new digital voice mail message; developing anunderstanding of the new voicemail by applying at least one of machinelearning and natural language processing to the new voicemail; selectingan item of visual content that is consistent with the understanding; andgenerating a sender-controlled media (SCM) data structure thatfacilitates linking the voice mail to the item of visual content.

In the methods and systems, the understanding of the audio contentcomprises an intent of the call, an object of the call, and an actionassociated with at least one of a caller leaving the message and anintended recipient of the message.

In the methods and systems, selecting is performed by a visual contentselection algorithm that performs a best fit of a visual content item tothe understanding.

In the methods and systems, the understanding comprises an intent thatis based on an intended recipient of the message.

In the methods and systems, the determined intent is based on arelationship of the intended recipient to a caller leaving the message.

The methods and systems of the present disclosure include developing anunderstanding of audio content of a voice mail message being played backon a computing device by applying at least one of machine learning andnatural language processing to the playback; selecting at least one itemof visual content that is consistent with the understanding; andpresenting the at least one item of visual content on a display screenof the computing device contemporaneously with the playback.

In the methods and systems, the understanding of the audio contentcomprises an intent of the call, an object of the call, and an actionassociated with at least one of a caller leaving the message and anintended recipient of the message.

In the methods and systems, selecting is performed by a visual contentselection algorithm that performs a best fit of a visual content item tothe understanding.

In the methods and systems, the understanding comprises an intent thatis based on an intended recipient of the message.

In the methods and systems, the determined intent is based on arelationship of the intended recipient to a caller leaving the message.

While only a few embodiments of the present disclosure have been shownand described, it will be obvious to those skilled in the art that manychanges and modifications may be made thereunto without departing fromthe spirit and scope of the present disclosure as described in thefollowing claims. All patent applications and patents, both foreign anddomestic, and all other publications referenced herein are incorporatedherein in their entireties to the full extent permitted by law.

The methods and systems described herein may be deployed in part or inwhole through a machine that executes computer software, program codes,and/or instructions on a processor. The present disclosure may beimplemented as a method on the machine, as a system or apparatus as partof or in relation to the machine, or as a computer program productembodied in a computer readable medium executing on one or more of themachines. In embodiments, the processor may be part of a server, cloudserver, client, network infrastructure, mobile computing platform,stationary computing platform, or other computing platforms. A processormay be any kind of computational or processing device capable ofexecuting program instructions, codes, binary instructions and the like.The processor may be or may include a signal processor, digitalprocessor, embedded processor, microprocessor or any variant such as aco-processor (math co-processor, graphic co-processor, communicationco-processor and the like) and the like that may directly or indirectlyfacilitate execution of program code or program instructions storedthereon. In addition, the processor may enable the execution of multipleprograms, threads, and codes. The threads may be executed simultaneouslyto enhance the performance of the processor and to facilitatesimultaneous operations of the application. By way of implementation,methods, program codes, program instructions and the like describedherein may be implemented in one or more threads. The thread may spawnother threads that may have assigned priorities associated with them;the processor may execute these threads based on priority or any otherorder based on instructions provided in the program code. The processor,or any machine utilizing one, may include non-transitory memory thatstores methods, codes, instructions and programs as described herein andelsewhere. The processor may access a non-transitory storage mediumthrough an interface that may store methods, codes, and instructions asdescribed herein and elsewhere. The storage medium associated with theprocessor for storing methods, programs, codes, program instructions orother type of instructions capable of being executed by the computing orprocessing device may include but may not be limited to one or more of aCD-ROM, DVD, memory, hard disk, flash drive, RAM, ROM, cache and thelike.

A processor may include one or more cores that may enhance speed andperformance of a multiprocessor. In embodiments, the process may be adual core processor, quad core processors, other chip-levelmultiprocessor and the like that combine two or more independent cores(called a die).

The methods and systems described herein may be deployed in part or inwhole through a machine that executes computer software on a server,client, firewall, gateway, hub, router, or other such computer and/ornetworking hardware. The software program may be associated with aserver that may include a file server, print server, domain server,internet server, intranet server, cloud server, and other variants suchas secondary server, host server, distributed server and the like. Theserver may include one or more of memories, processors, computerreadable media, storage media, ports (physical and virtual),communication devices, and interfaces capable of accessing otherservers, clients, machines, and devices through a wired or a wirelessmedium, and the like. The methods, programs, or codes as describedherein and elsewhere may be executed by the server. In addition, otherdevices required for execution of methods as described in thisapplication may be considered as a part of the infrastructure associatedwith the server.

The server may provide an interface to other devices including, withoutlimitation, clients, other servers, printers, database servers, printservers, file servers, communication servers, distributed servers,social networks, and the like. Additionally, this coupling and/orconnection may facilitate remote execution of program across thenetwork. The networking of some or all of these devices may facilitateparallel processing of a program or method at one or more locationwithout deviating from the scope of the disclosure. In addition, any ofthe devices attached to the server through an interface may include atleast one storage medium capable of storing methods, programs, codeand/or instructions. A central repository may provide programinstructions to be executed on different devices. In thisimplementation, the remote repository may act as a storage medium forprogram code, instructions, and programs.

The software program may be associated with a client that may include afile client, print client, domain client, internet client, intranetclient and other variants such as secondary client, host client,distributed client and the like. The client may include one or more ofmemories, processors, computer readable media, storage media, ports(physical and virtual), communication devices, and interfaces capable ofaccessing other clients, servers, machines, and devices through a wiredor a wireless medium, and the like. The methods, programs, or codes asdescribed herein and elsewhere may be executed by the client. Inaddition, other devices required for execution of methods as describedin this application may be considered as a part of the infrastructureassociated with the client.

The client may provide an interface to other devices including, withoutlimitation, servers, other clients, printers, database servers, printservers, file servers, communication servers, distributed servers andthe like. Additionally, this coupling and/or connection may facilitateremote execution of program across the network. The networking of someor all of these devices may facilitate parallel processing of a programor method at one or more location without deviating from the scope ofthe disclosure. In addition, any of the devices attached to the clientthrough an interface may include at least one storage medium capable ofstoring methods, programs, applications, code and/or instructions. Acentral repository may provide program instructions to be executed ondifferent devices. In this implementation, the remote repository may actas a storage medium for program code, instructions, and programs.

The methods and systems described herein may be deployed in part or inwhole through network infrastructures. The network infrastructure mayinclude elements such as computing devices, servers, routers, hubs,firewalls, clients, personal computers, communication devices, routingdevices and other active and passive devices, modules and/or componentsas known in the art. The computing and/or non-computing device(s)associated with the network infrastructure may include, apart from othercomponents, a storage medium such as flash memory, buffer, stack, RAM,ROM and the like. The processes, methods, program codes, instructionsdescribed herein and elsewhere may be executed by one or more of thenetwork infrastructural elements. The methods and systems describedherein may be adapted for use with any kind of private, community, orhybrid cloud computing network or cloud computing environment, includingthose which involve features of software as a service (SaaS), platformas a service (PaaS), and/or infrastructure as a service (IaaS).

The methods, program codes, and instructions described herein andelsewhere may be implemented on a cellular network having multiplecells. The cellular network may either be frequency division multipleaccess (FDMA) network or code division multiple access (CDMA) network.The cellular network may include mobile devices, cell sites, basestations, repeaters, antennas, towers, and the like. The cell networkmay be a GSM, GPRS, 3G, EVDO, mesh, or other networks types.

The methods, program codes, and instructions described herein andelsewhere may be implemented on or through mobile devices. The mobiledevices may include navigation devices, cell phones, mobile phones,mobile personal digital assistants, laptops, palmtops, netbooks, pagers,electronic books readers, music players and the like. These devices mayinclude, apart from other components, a storage medium such as a flashmemory, buffer, RAM, ROM and one or more computing devices. Thecomputing devices associated with mobile devices may be enabled toexecute program codes, methods, and instructions stored thereon.Alternatively, the mobile devices may be configured to executeinstructions in collaboration with other devices. The mobile devices maycommunicate with base stations interfaced with servers and configured toexecute program codes. The mobile devices may communicate on apeer-to-peer network, mesh network, or other communications network. Theprogram code may be stored on the storage medium associated with theserver and executed by a computing device embedded within the server.The base station may include a computing device and a storage medium.The storage device may store program codes and instructions executed bythe computing devices associated with the base station.

The computer software, program codes, and/or instructions may be storedand/or accessed on machine readable media that may include: computercomponents, devices, and recording media that retain digital data usedfor computing for some interval of time; semiconductor storage known asrandom access memory (RAM); mass storage typically for more permanentstorage, such as optical discs, forms of magnetic storage like harddisks, tapes, drums, cards and other types; processor registers, cachememory, volatile memory, non-volatile memory; optical storage such asCD, DVD; removable media such as flash memory (e.g., USB sticks orkeys), floppy disks, magnetic tape, paper tape, punch cards, standaloneRAM disks, Zip drives, removable mass storage, off-line, and the like;other computer memory such as dynamic memory, static memory, read/writestorage, mutable storage, read only, random access, sequential access,location addressable, file addressable, content addressable, networkattached storage, storage area network, bar codes, magnetic ink, and thelike.

The methods and systems described herein may transform physical and/orintangible items from one state to another. The methods and systemsdescribed herein may also transform data representing physical and/orintangible items from one state to another.

The elements described and depicted herein, including in flow charts andblock diagrams throughout the figures, imply logical boundaries betweenthe elements. However, according to software or hardware engineeringpractices, the depicted elements and the functions thereof may beimplemented on machines through computer executable media having aprocessor capable of executing program instructions stored thereon as amonolithic software structure, as standalone software modules, or asmodules that employ external routines, code, services, and so forth, orany combination of these, and all such implementations may be within thescope of the present disclosure. Examples of such machines may include,but may not be limited to, personal digital assistants, laptops,personal computers, mobile phones, other handheld computing devices,medical equipment, wired or wireless communication devices, transducers,chips, calculators, satellites, tablet PCs, electronic books, gadgets,electronic devices, devices having artificial intelligence, computingdevices, networking equipment, servers, routers and the like.Furthermore, the elements depicted in the flowchart and block diagramsor any other logical component may be implemented on a machine capableof executing program instructions. Thus, while the foregoing drawingsand descriptions set forth functional aspects of the disclosed systems,no particular arrangement of software for implementing these functionalaspects should be inferred from these descriptions unless explicitlystated or otherwise clear from the context. Similarly, it will beappreciated that the various steps identified and described above may bevaried and that the order of steps may be adapted to particularapplications of the techniques disclosed herein. All such variations andmodifications are intended to fall within the scope of this disclosure.As such, the depiction and/or description of an order for various stepsshould not be understood to require a particular order of execution forthose steps, unless required by a particular application, or explicitlystated or otherwise clear from the context.

The methods and/or processes described above, and steps associatedtherewith, may be realized in hardware, software or any combination ofhardware and software suitable for a particular application. Thehardware may include a general-purpose computer and/or dedicatedcomputing device or specific computing device or particular aspect orcomponent of a specific computing device. The processes may be realizedin one or more microprocessors, microcontrollers, embeddedmicrocontrollers, programmable digital signal processors or otherprogrammable devices, along with internal and/or external memory. Theprocesses may also, or instead, be embodied in an application specificintegrated circuit, a programmable gate array, programmable array logic,or any other device or combination of devices that may be configured toprocess electronic signals. It will further be appreciated that one ormore of the processes may be realized as a computer executable codecapable of being executed on a machine-readable medium.

The computer executable code may be created using a structuredprogramming language such as C, an object oriented programming languagesuch as C++, or any other high-level or low-level programming language(including assembly languages, hardware description languages, anddatabase programming languages and technologies) that may be stored,compiled or interpreted to run on one of the above devices, as well asheterogeneous combinations of processors, processor architectures, orcombinations of different hardware and software, or any other machinecapable of executing program instructions.

Thus, in one aspect, methods described above and combinations thereofmay be embodied in computer executable code that, when executing on oneor more computing devices, performs the steps thereof. In anotheraspect, the methods may be embodied in systems that perform the stepsthereof and may be distributed across devices in a number of ways, orall of the functionality may be integrated into a dedicated, standalonedevice or other hardware. In another aspect, the means for performingthe steps associated with the processes described above may include anyof the hardware and/or software described above. All such permutationsand combinations are intended to fall within the scope of the presentdisclosure.

The method steps of the implementations described herein are intended toinclude any suitable method of causing such method steps to beperformed, consistent with the patentability of the following claimsunless a different meaning is expressly provided or otherwise clear fromthe context. So, for example performing the step of X includes anysuitable method for causing another party such as a remote user, aremote processing resource (e.g., a server or cloud computingenvironment) or a machine to perform the step of X. Similarly,performing steps X, Y and Z may include any method of directing orcontrolling any combination of such other individuals or resources toperform steps X, Y and Z to obtain the benefit of such steps. Thus,method steps of the implementations described herein are intended toinclude any suitable method of causing one or more other parties orentities to perform the steps, consistent with the patentability of thefollowing claims, unless a different meaning is expressly provided orotherwise clear from the context. Such parties or entities need not beunder the direction or control of any other party or entity and need notto be located within a particular jurisdiction.

While the disclosure has been disclosed in connection with the preferredembodiments shown and described in detail, various modifications andimprovements thereon will become readily apparent to those skilled inthe art. Accordingly, the spirit and scope of the present disclosure isnot to be limited by the foregoing examples but is to be understood inthe broadest sense allowable by law.

The use of the terms “a” and “an” and “the” and similar referents in thecontext of describing the disclosure (especially in the context of thefollowing claims) is to be construed to cover both the singular and theplural unless otherwise indicated herein or clearly contradicted bycontext. The terms “comprising,” “having,” “including,” and “containing”are to be construed as open-ended terms (i.e., meaning “including, butnot limited to,”) unless otherwise noted. Recitations of ranges ofvalues herein are merely intended to serve as a shorthand method ofreferring individually to each separate value falling within the range,unless otherwise indicated herein, and each separate value isincorporated into the specification as if it were individually recitedherein. All methods described herein may be performed in any suitableorder unless otherwise indicated herein or otherwise clearlycontradicted by context. The use of any and all examples, or exemplarylanguage (e.g., “such as”) provided herein, is intended merely to betterilluminate the disclosure and does not pose a limitation on the scope ofthe disclosure unless otherwise claimed. No language in thespecification should be construed as indicating any non-claimed elementas essential to the practice of the disclosure.

While the foregoing written description enables one skilled in the artto make and use what is considered presently to be the best modethereof, those skilled in the art will understand and appreciate theexistence of variations, combinations, and equivalents of the specificembodiment, method, and examples herein. The disclosure should thereforenot be limited by the above described embodiment, method, and examples,but by all embodiments and methods within the scope and spirit of thedisclosure. All documents referenced herein are hereby incorporated byreference.

What is claimed is:
 1. A system comprising: a computer to computerinterface configured to facilitate communication between a messagingplatform that is adapted to associate a hash tag with a message and acontent matching platform, the communication between the messagingplatform and the content matching platform comprising at least one ofmessages and hash tags; a natural language processing facility of thecontent matching platform producing an output comprising at least one ofan understanding, theme, emotion, and intent of a message communicatedfrom the messaging platform; and a metadata matching facility incommunication with the content matching platform, the metadata matchingfacility configured to identify candidate hash tags by determiningsimilarity of hash tags in a pool of hash tags with an output of thenatural language processing, the content matching facility communicatingat least one of the candidate hash tags to the messaging platform overthe computer to computer interface.
 2. The system of claim 1, furthercomprising an electronic user interface that facilitates user selectionof one or more of the candidate hash tags that the content matchingfacility communicates to the messaging platform for associating with themessage processed by the natural language processing facility.
 3. Thesystem of claim 1, wherein the computer to computer interface is anApplication Programming Interface (API).
 4. The system of claim 1,wherein determining similarity of hash tags with an output of thenatural language processing of the message includes determiningsimilarity of metadata associated with the hash tags.
 5. The system ofclaim 1, wherein the metadata associated with the hash tags is generatedby processing the hash tags with the natural language processingfacility.
 6. The system of claim 1, wherein the at least one of thecandidate hash tags indicates an emotion of the message.
 7. The systemof claim 1, wherein the at least one of the candidate hash tagsindicates an intent of the message.
 8. The system of claim 1, whereinthe content matching platform tags the message with the at least onecandidate hash tags and communicates the tagged message to the messagingplatform.
 9. The system of claim 1, further comprising the contentmatching platform communicating the output of natural languageprocessing of the message to the messaging platform.
 10. A systemcomprising: a computer to computer interface configured to facilitatecommunication between a messaging platform that is adapted to associatea hash tag with a message and a content matching platform, thecommunication between the messaging platform and the content matchingplatform comprising at least one of messages and hash tags; a naturallanguage processing facility of the content matching platform producingan output comprising at least one of an understanding, theme, emotion,and intent of a message communicated from the messaging platform and ofa plurality of hash tags in a pool of hash tags; and a metadata matchingfacility configured to determine candidate hash tags by determiningsimilarity of an output of the natural language processing for theplurality of hash tags with an output of the natural language processingfor the message communicated from the messaging platform, the contentmatching facility communicating at least one candidate hash tag based onthe determined similarity to the messaging platform over the computer tocomputer interface.
 11. The system of claim 10, wherein the output ofthe natural language processing of the at least one candidate hash tagis more similar to the output of the natural language processing of themessage than the natural language processing of any of the other hashtags in the pool of hash tags.
 12. The system of claim 10, furthercomprising an electronic user interface that facilitates user selectionof one or more of the candidate hash tags that the content matchingfacility communicates to the messaging platform for associating with themessage processed by the natural language processing facility.
 13. Thesystem of claim 10, wherein the computer to computer interface is anApplication Programming Interface (API).
 14. The system of claim 10,wherein determining similarity of hash tags with an output of thenatural language processing of the message includes determiningsimilarity of metadata associated with the hash tags.
 15. The system ofclaim 10, wherein the metadata associated with the hash tags isgenerated by processing the hash tags with the natural languageprocessing facility.
 16. A method comprising: communicating a portion ofa message from a messaging platform to a content matching platform;processing text in the portion of the message with natural languageprocessing, thereby generating an NLP output comprising at least one ofa theme, understanding, intent, and emotion of the message; determiningsimilarity of the NLP output with a plurality of hash tags; andcommunicating at least one candidate hash tag for the message to themessaging platform based on the determined similarity.
 17. The method ofclaim 16, wherein determining similarity comprises comparing a portionof the NLP output with the hash tags.
 18. The method of claim 16,wherein determining similarity comprises comparing a portion of the NLPoutput with metadata descriptive of the hash tags.
 19. The method ofclaim 16, further comprising facilitating user selection of the at leastone candidate hash tag by presenting in an electronic user interface aplurality of hash tags based on the determined similarity.
 20. Themethod of claim 16, wherein the communicating a portion of a message andcommunicating at least one candidate hash tag utilizes an ApplicationProgramming Interface between the content matching platform and themessaging platform.